Hello , i created a pipeline and it runs without errors , the output is as expected which is 2777 records however when i run preview it shows no data records except for the one in the screenshot below .
and i couldn’t know why this happens .
Solved
preview doesn't show the records data.
- Opening Band
- 19 replies
Best answer by N_ali
i figured out the problem ,
it turns out that when i enable on archive in SFTP/FTPS client , the result data won’t show in the preview.
i disabled the on archive and it is now shown again.
- StreamSets Employee
- 83 replies
Data Collector keeps track of an offset at the origin which is intended to avoid duplicating data if you run the pipeline again. I think that same offset management is what's preventing data from showing up in the preview.
if you do choose to reset the origin offset, it should start showing up.
- Opening Band
- 19 replies
i reset the origin and ran the pipeline again but it displayed the same thing above.
i tried new files for ftp to process it but the same thing happens it displays the count but i can’t preview the data
+1- Headliner
- 486 replies
i can see the sftp origin is showing ‘0’ records , can you please check if you have the file exists in it which one you are trying to retrieve and also check the file format as well .
Try to run the pipeline and also check if you manage to read data from the file itself or not.
Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.