Question

How to automatically Reset Origin the Oracle CDC Data Collector Pipeline when encountering ORA-01291: missing logfile?

  • 13 April 2023
  • 0 replies
  • 27 views

 

I want to handle a specific error that occurs when the CDC Oracle pipeline fails to start due to an ORA-01291 "missing logfile" error. I want it to automatically reset the origin and restart the pipeline. By default, the pipeline retries with the last committed offset whenever it encounters an ORA-01291 error, but I want to handle it so that it resets the origin before retrying or restarting the pipeline. I couldn't find any setting to handle errors that cause the pipeline to fail during startup (not the error records).

I understand that resetting the origin when encountering a missing logfile error can cause missing data, but I have already created another pipeline to resolve that issue. My goal is to ensure that my CDC pipeline keeps running even when it encounters an ORA-01291 error by automatically skipping the missing log file through resetting the origin.


Thank you.

Edit:
I’m using StreamSets Data Collector 5.1.0 on StreamSets Control Hub 3.50.1.


0 replies

Be the first to reply!

Reply