Question

How to retain original file name when writing to s3?

  • 23 January 2024
  • 2 replies
  • 31 views

I read from an SFTP server and when writing to S3 my files get renamed. How can I retain the original file name?


2 replies

You could use Amazon S3 executor and rename the file after it’s been written.

Also the question depends on what format you’re using when reading files from SFTP. With Whole Files it’s easy, but if it’s something else than Whole File, you may not even have the file’s boundaries preserved, ie the file may be split (due to file size limits you configured in S3 destination) or merged with other source files.

Userlevel 5
Badge +1

 

@andalv 

Please give a try with whole file option in both origin and destination. In s3 , configure the filename which will take the file name from origin .

 

 

 

Reply