Skip to main content
Question

Reusing a component in streamsets

  • July 27, 2022
  • 5 replies
  • 39 views

Hi Team,

I want to reuse a shell-script across mutiple pipelines in data collector.

How to acheive this Without using fragments concept.

 

 

5 replies

dima
StreamSets Employee
Forum|alt.badge.img
  • StreamSets Employee
  • 83 replies
  • July 27, 2022

We designed pipeline fragments for this very scenario. Is there a specific reason you don't want to use them?


  • Author
  • Fan
  • 4 replies
  • July 27, 2022

Specifically, we have challenges to use fragments.

So requested for an approch where I can design one shell script and use it for multiple pipelines,

Appreciate if anyone can help on this


dima
StreamSets Employee
Forum|alt.badge.img
  • StreamSets Employee
  • 83 replies
  • July 27, 2022

What challenges? 


  • Author
  • Fan
  • 4 replies
  • July 27, 2022

Challenges with -- versioning sometimes.

So, do we have any workaround for this?


dima
StreamSets Employee
Forum|alt.badge.img
  • StreamSets Employee
  • 83 replies
  • July 27, 2022

What specific challenges with versioning? Can you please provide some more details?