In Transformer, i sent data from file(directory) to file(local fs)
but the destination will got error
JOBRUNNER_63 - Pipeline status: 'RUN_ERROR', message: 'Operator File_3 failed due to org.apache.spark.sql.AnalysisException, check Driver Logs for further information'
RUN_ERROR: Operator File_3 failed due to org.apache.spark.sql.AnalysisException, check Driver Logs for further information (View Stack Trace... )
how to clear the error and I need help to clear the error
Thanks
Tamilarasu
Best answer by Bikram
Kindly check the driver logs ,it will tell the reason of failure.
Can you please attach the error logs to check the reason of failure?
Thanks & Regards
Bikram_
generally this error comes up when the input fields are not mapped correctly.
I would recommend Preview and see where the issue is.
after thati use files means it’s not working
+1Kindly check the driver logs ,it will tell the reason of failure.
Can you please attach the error logs to check the reason of failure?
Thanks & Regards
Bikram_
Please check the fields in preview just before the destination.
Kindly check the driver logs ,it will tell the reason of failure.
Can you please attach the error logs to check the reason of failure?
Thanks & Regards
Bikram_
Thank you
now its working..
above scenario now destination will be delta lake. storage Aws or ADLS2.
in cluster configuration i using databricks.
i got error as
how to connect or solve this - The Transformer Spark application in the Spark cluster might not be able to reach Transformer at ‘http://661f1312d1e9:19630’.
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
