Skip to main content
Solved

List Pipeline Stages

S
Fan

Is it possible to list the stages of an existing pipeline once you have the existing pipeline in the builder?

Best answer by saleempothiwala

@songforwhoever 

 

You can find more information here: https://docs.streamsets.com/sdk/latest/index.html

You will have to get your SDK activation code from StreamSets Support.

pip3 install streamsets~=3.0 

python3

from streamsets.sdk import ControlHub

sch = ControlHub('<YOUR CONTROL HUB URL>', '<YOUR USERNAME>', '<YOUR PASSWORD>')
#Gets instance of your SCH


pipeline = control_hub.pipelines.get(name = '<YOUR PIPELINE NAME>')
#gets instance of your pipeline

pipeline.stages
#this will give you list of all the stages

 

View original
Did this topic help you find an answer to your question?

saleempothiwala
Headliner
Forum|alt.badge.img

hi @songforwhoever 

 

Yes, it is possible to do so using the Python SDK for StreamSets.

More help here: https://docs.streamsets.com/platform-sdk/latest/index.html

S
Fan
saleempothiwala wrote:

hi @songforwhoever 

 

Yes, it is possible to do so using the Python SDK for StreamSets.

More help here: https://docs.streamsets.com/platform-sdk/latest/index.html

 

Thanks, can you be more specific on where I can found out how to do this? I’ve looked through the documentation but not found anything - maybe it’s how I’m searching for it that’s the problem

saleempothiwala
Headliner
Forum|alt.badge.img

@songforwhoever 

 

What is the version of your Control Hub?

S
Fan
CH 3.19.2
saleempothiwala
Headliner
Forum|alt.badge.img

@songforwhoever 

 

You can find more information here: https://docs.streamsets.com/sdk/latest/index.html

You will have to get your SDK activation code from StreamSets Support.

pip3 install streamsets~=3.0 

python3

from streamsets.sdk import ControlHub

sch = ControlHub('<YOUR CONTROL HUB URL>', '<YOUR USERNAME>', '<YOUR PASSWORD>')
#Gets instance of your SCH


pipeline = control_hub.pipelines.get(name = '<YOUR PIPELINE NAME>')
#gets instance of your pipeline

pipeline.stages
#this will give you list of all the stages

 

S
Fan
saleempothiwala wrote:

@songforwhoever

 

You can find more information here: https://docs.streamsets.com/sdk/latest/index.html

You will have to get your SDK activation code from StreamSets Support.

pip3 install streamsets~=3.0 

python3

from streamsets.sdk import ControlHub

sch = ControlHub('<YOUR CONTROL HUB URL>', '<YOUR USERNAME>', '<YOUR PASSWORD>')
#Gets instance of your SCH


pipeline = control_hub.pipelines.get(name = '<YOUR PIPELINE NAME>')
#gets instance of your pipeline

pipeline.stages
#this will give you list of all the stages

 

Fantastic, Thank you @saleempothiwala - that’s really useful.

Reply


Terms & Conditions