A pipeline’s origin is an S3 bucket. Error records are configured to “Send Response to Origin.” What exactly happens to the error records in this instance?
Best answer by dima
View originalA pipeline’s origin is an S3 bucket. Error records are configured to “Send Response to Origin.” What exactly happens to the error records in this instance?
Best answer by dima
View originalhttps://docs.streamsets.com/portal/datacollector/latest/help/datacollector/UserGuide/Pipeline_Design/ErrorHandling.html#concept_kgc_l4y_5r indicates the following:
Send Response to Origin
The pipeline passes error records back to the microservice origin to be included in a response to the originating REST API client. Data Collector includes the records in error record counts and metrics. Use in microservice pipelines only.
I read that too, but what does it mean in the context of an S3 origin? Please distill it down for me.
Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.