how to create the pipeline for the xml data where it is taken from sftp in the streamsets we have getting only 1 record from sftp in the preview data
how to create the pipeline for the xml data where it is taken from sftp
Userlevel 5
+1
- Headliner
- 485 replies
-
2 May 2024
While it may display only one record in the preview, please execute the pipeline to verify if it successfully retrieved all the data from the source file.
- Fan
- 4 replies
-
9 May 2024
SFTP origin delivers data in Whole File format, that’s why you see one record -- it’s only a record with the reference to the file.
Your destination should also be in Whole File format. Then you can (if you wish) read inside the file using a second pipeline.
Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.