Question

DC Pipeline Validation pass but Failed for draft run, log no clear message for rootcause of failure

  • 20 August 2022
  • 4 replies
  • 21 views

Hi Team, I am building a DC pipeline to load a small table data from Oracle origin to Snowflake, validation pass but failed for draft run (I click “Reset Origin and Start”), I searched the log, there is only warning

WARN Exception thrown while trying to remove temporary directory /opt/streamsets-datacollector/tmp/sdc148432276299548840

can you please guide hwo to debug it? Thank you.


4 replies

by the way, is there a way to download or export the StreamSets pipeline running log?

Userlevel 4
Badge

@Dolphin, it is difficult to guess to issue in the pipeline without more details. 

 

The log you see for the pipeline is a subset of sdc.log file that is shown in pipeline with relevant rows related to your pipeline. You can select the log lines and copy in notepad to save it

 

Hi saleempothiwala 

I attached the failed pipleline log here, can you please help check? thanks

Hi team any update for this? Can you please guide how to track it?

Reply