30-Day Free Trial: It’s Never Been Easier To Get Started With StreamSets
hi streamsets community,
we need to export the listing of all pipelines that exist in streamsets by rest api
How can we do that?
@Yago Aparecido , have you looked into SDK for Python for this purpose? If not, I would highly recommend it.
If you are on DataOps Platform, https://docs.streamsets.com/platform-sdk/latest/index.html
else if you are on 3.x ,
https://docs.streamsets.com/sdk/latest/index.html
In fact, there is SDK tutorial which has similar code to loop over pipelines:
https://github.com/streamsets/tutorials/blob/master/sdk-tutorials/sch/tutorial-pipelines/edit-pipelines-and-stages/README.md#step-3--loop-over-pipelines-to-add-label-to-each
and for import/export of pipelines in:
https://github.com/streamsets/tutorials/tree/master/sdk-tutorials/sch/tutorial-pipelines/common-pipeline-methods#step-5--export-and-import-the-pipeline
hi @Kirti
I used the "RESTful API" and apparently it's working for what we need.
if we need more details I will try to look at the SDK, thanks for the help.
The StreamSets Community has your back.
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.
Sorry, our virus scanner detected that this file isn't safe to download.