I have a text file in my “/tmp” directory named “data.txt”
Now every time when I run the pipeline, I want to write data to the same file.
I was trying to use LocalFS but I couldnt find anyway wherein I could append data to the same file.
Can anyone help me out with this?
Appending is not possible by using local FS as destination but you can append the data to the existing file by using shell processor as your destination.
Kindly use shell as your destination and use mv command in it to append data into the existing file.
I was trying out what you suggested me but im getting an error saying that its returning non-zero.
ie Error : “SHELL_003 - Script return non-zero value: 1”
This is the pipeline that I’m trying to get running.
Can you please correct me where I’m going wrong !!
Please find attached the pipeline for your issues.
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.