how to create the pipeline for the xml data where it is taken from sftp in the streamsets we have getting only 1 record from sftp in the preview data
Page 1 / 1
While it may display only one record in the preview, please execute the pipeline to verify if it successfully retrieved all the data from the source file.
SFTP origin delivers data in Whole File format, that’s why you see one record -- it’s only a record with the reference to the file.
Your destination should also be in Whole File format. Then you can (if you wish) read inside the file using a second pipeline.
Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.