Question

Truncate and load ADSL folder


Hi, 

I want to truncate and load ADSL folder using Streamsets pipeline. Can you suggest some way to achieve truncate and load feature in Streamsets


2 replies

Userlevel 5
Badge +1

Hi @jk56273 

can you please elaborate your issue in details.

Thanks & Regards,

Bikram_

 

Userlevel 2
Badge

Hi @jk56273 
You can try using the Start Event - ADLS Gen2 File Metadata in the pipeline.

By using this you can truncate the folder before the pipeline start and after that you can load the data into the ADLS.

If the provide suggestion did not help, then please elaborate your requirement.

Reply