how to create the pipeline for the xml data where it is taken from sftp in the streamsets we have getting only 1 record from sftp in the preview data
SFTP origin delivers data in Whole File format, that’s why you see one record -- it’s only a record with the reference to the file.
Your destination should also be in Whole File format. Then you can (if you wish) read inside the file using a second pipeline.
Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.