Question

Need more info on the two events for SFTP destination?

  • 1 May 2023
  • 2 replies
  • 25 views

Hello,

I am referring to this documentation : https://docs.streamsets.com/portal/platform-datacollector/latest/datacollector/UserGuide/Destinations/SFTP.html#concept_sgt_m2m_xhb

There are two Event types - Uses one of the following types:

  • file-closed - Generated when the destination closes a file.
  • wholeFileProcessed - Generated when the destination completes streaming a whole file.

If I have to add an executor to move the file from this destination then to some other location upon receiving an event, which event I have to use? 

Are there any more steps between wholeFileProcessed and file-closed? Is there anything more after the event file-closed is triggered? 

Dhanashri


2 replies

Userlevel 4
Badge

@Dhanashri_Bhate 

 

Use file-closed if you are using the file as data with formats other than wholefile.

 

If your data format is wholefile then use the second event.

Thanks Saleem!

Reply