Question

AWS S3 Events in Streamsets on-cloud

  • 15 November 2022
  • 2 replies
  • 35 views
P
Rank

How we can capture AWS S3 Events in streamsets on cloud,which service we can use here? 

2 replies

alex.sanchez
Rank
Userlevel 2
Badge

Hi @Priya151997 

S3 Events are not natively supported, we can read/write data to S3, but we don’t have direct support for events.

You can probably craft something with AWS Lambda and/or Scripting stages, but that will require some work.

 

Thanks

Alex - StreamSets Engineering Manager @ Collector
saleempothiwala
Rank
Userlevel 4
Badge

@Priya151997 

What alex said 

PLUS

Also, you can set it to write events to SQS and then use SQS Origin to read the events.

Reply


Terms & Conditions