Skip to main content
Question

DC Pipeline Validation pass but Failed for draft run, log no clear message for rootcause of failure


Hi Team, I am building a DC pipeline to load a small table data from Oracle origin to Snowflake, validation pass but failed for draft run (I click “Reset Origin and Start”), I searched the log, there is only warning

WARN Exception thrown while trying to remove temporary directory /opt/streamsets-datacollector/tmp/sdc148432276299548840

can you please guide hwo to debug it? Thank you.

4 replies

  • Author
  • Discovered Fame
  • 20 replies
  • August 20, 2022

by the way, is there a way to download or export the StreamSets pipeline running log?


saleempothiwala
Headliner
Forum|alt.badge.img

@Dolphin, it is difficult to guess to issue in the pipeline without more details. 

 

The log you see for the pipeline is a subset of sdc.log file that is shown in pipeline with relevant rows related to your pipeline. You can select the log lines and copy in notepad to save it

 


  • Author
  • Discovered Fame
  • 20 replies
  • August 22, 2022

Hi saleempothiwala 

I attached the failed pipleline log here, can you please help check? thanks


  • Author
  • Discovered Fame
  • 20 replies
  • August 27, 2022

Hi team any update for this? Can you please guide how to track it?


Reply