Skip to main content

Why should I parameterize everything?

  • January 14, 2022
  • 2 replies
  • 98 views

AnnieB
StreamSets Employee

There are two main reasons you want to parameterize your pipelines: 

1. Parameterization helps support code migration between environments/orgs. Users have two separate orgs, and so helps moving pipelines from lower to higher environments. Since the parameters are in a separate section you can just update it in one section instead of breaking into the code/each stage each time.

2. Within a single org, parameters help you set the values as part of jobs. Since parameters get exposed at the job level you can pass them there depending on your environment. With parameterization you can create multiple jobs based on a single pipeline. Thinking of it like a class with jobs being instances of a class.

2 replies

At canvas level, we have created parameters for source and target JDBC connection strings. 

Now, we are moving pipelines/jobs from dev to qa and then to prod.

In this case is there any way not to update or change the parameters for JDBC connection strings manually for QA and PROD.

If possible, can please share any example. 

Thank You.

 

 


wilsonshamim
StreamSets Employee
Forum|alt.badge.img+1
  • StreamSets Employee
  • March 16, 2022

@raghuramxlsoftek : hope the below links helps. you can use parameters in the connections.