Question

Reusing a component in streamsets

  • 27 July 2022
  • 5 replies
  • 22 views

Hi Team,

I want to reuse a shell-script across mutiple pipelines in data collector.

How to acheive this Without using fragments concept.

 

 


5 replies

Userlevel 3
Badge

We designed pipeline fragments for this very scenario. Is there a specific reason you don't want to use them?

Specifically, we have challenges to use fragments.

So requested for an approch where I can design one shell script and use it for multiple pipelines,

Appreciate if anyone can help on this

Userlevel 3
Badge

What challenges? 

Challenges with -- versioning sometimes.

So, do we have any workaround for this?

Userlevel 3
Badge

What specific challenges with versioning? Can you please provide some more details?

Reply