Skip to main content
Question

Inject params to pipeline


miguelrezende7rox
Fan

Hi guys! 

I'm building a pipeline that uses a token that is updated hourly. So when I start the pipeline I have to input it as a parameter (or in another way that works). 

I'm facing problem to inject the token using the api or another pipeline, anyone could help?

 

 

 

 

2 replies

Pradeep
StreamSets Employee
Forum|alt.badge.img+1
  • StreamSets Employee
  • 48 replies
  • November 4, 2022

One way that you could solve this is by passing token as a runtime value to the respective pipeline parameter. You might want to update the respective resource/property hourly on respective datacollector instance(s) so that pipeline parameter could pick up as required.

Ref https://docs.streamsets.com/portal/platform-datacollector/latest/datacollector/UserGuide/Pipeline_Configuration/RuntimeValues.html#concept_bs4_5nm_2s for more details.


saleempothiwala
Headliner
Forum|alt.badge.img

@miguelrezende7rox,

Try and see if this approach works:

 

 


Reply