Skip to main content

HI,

 

I have tried copy all the files from one folder to another folder with in same s3 bucket using streamsets job. But I am seeing only 1 or 2 files copied into destination folder compared to source folder(like in source folder if 7 files are there, but in destination folder I am seeing 1 or 2 files are copying). Can any one help me on this issue.

 

Thanks

Murali

Hi @mySSname , Could you please make sure AWS S3 origin configure correctly to read all the object to read from that S3 bucket

i.e

  • Make sure Prefix pattern that configured in S3 origin describes the objects to be processed( all the remaining files) 

However, if issue persist then please share the pipeline export from data collector and filename pattern from S3  source bucket.

Reply


Terms & Conditions