Skip to main content
Question

how to create the pipeline for the xml data where it is taken from sftp

how to create the pipeline for the xml data where it is taken from sftp in the streamsets we have getting only 1 record from sftp in the preview data 

2 replies

Bikram
Rank
Userlevel 5
Badge +1

@moviepages 

 

 

While it may display only one record in the preview, please execute the pipeline to verify if it successfully retrieved all the data from the source file.

roma
Rank

SFTP origin delivers data in Whole File format, that’s why you see one record -- it’s only a record with the reference to the file.

Your destination should also be in Whole File format. Then you can (if you wish) read inside the file using a second pipeline.

Reply


Terms & Conditions