Skip to main content
Question

Reset Origins for Pipelines

  • 23 August 2024
  • 4 replies
  • 26 views

I have a number of pipelines, all of which use the JDBC Multitable Consumer as the Origin.  I’m resetting the origins with a pipeline finisher but if I need to stop the pipeline or it doesn’t complete the origins don’t get reset.  The documentation says they can be reset from the Job Instances view, but I don’t see that menu option.



 

Hi, @pkandra. They are referring to a manual option, as shown here in this screenshot. There is no means by which to do this programmatically that I am aware of if you need to stop a pipeline manually.

 

As mentioned in the documentation, you can also reset origin from a Topology:
 

 

Thanks for the replies.  I was hoping for a programmatic solution but either of these ways will do.

If you are using Python SDK then 

 

# Get all jobs available from Control Hub, then reset each of their originsjobs = sch.jobssch.reset_origin(*jobs)

If you are using REST API then

https://eu02.hub.streamsets.com/jobrunner/rest/v1/job/{jobId}/resetOffset

Reply


Terms & Conditions