Question

Invoking a SDC job with a set of input parameters

  • 10 January 2022
  • 4 replies
  • 53 views

Hi, 

We know a SDC job be involked through HTTP endpoint and can a set of parameters be passed as input parameter?

Effectively we want the following :

Originating system X > invoke SDC job with a set of parameters > SDC job looks up a database table with the passed on parameters > Returns the results to a different external system Y[ note its not the originating system X] > Send a response back to Originating system with a pass/fail status.

Any demo pipeline will help. Are we advised to use REST Service origin for https://docs.streamsets.com/portal/controlhub/latest/help/datacollector/UserGuide/Microservice/Microservice_Title.html

Regards, Anirban


4 replies

Userlevel 4
Badge

Hi @anirbanch , please check Orchestration stages,  this might help with your use-case.

https://docs.streamsets.com/portal/controlhub/latest/help/datacollector/UserGuide/Orchestration_Pipelines/OrchestrationPipelines_Title.html#concept_x43_wlc_zlb__section_qtk_mlq_zlb

 

Userlevel 5
Badge

@anirbanch did Rishi’s suggestion help? If so, Please mark as “Best answer” as this will help others find the answer quicker. :) 

Hi @Drew Kreiger  we deep dived and found that REST Service Origin fits best in our use case. 

Userlevel 5
Badge

Awesome! Glad @Rishi was able to point the team into the right direction. 

Reply