I have an usecase where we need to read from the source and write all the records into a text file using streamsets. Is it possible to write all the records as a text file?
The Local FS destination lets you do this. See our docs.
Hey Dima,thanks for the answer.I ’d like know if we can write directly as a text file to NAS location(using SFTP) ?
The SFTP destination only writes directly via the Whole File format. Your best bet would be to write to Local FS and then have a separate process move the complete file via SFTP.
Reply
Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.