Skip to main content

Does StreamSets Data Collector and Transformer support integration with Airlfow? Could you please share details on the integration? i.e. Prebuild StreamSets Operator for Airflow

Hi @srinivasanvar

There is no StreamSets Operator for Airflow. What’s your use case?


Dear @Dash

 

We use airflow as the orchestration tool and it needs to integrate with StreamSets Data Collector / Transformer for a set of steps. Wanted to understand approach for integrating airflow with StreamSets.

 

Regards

Varadha


Hey @srinivasanvar!

Got it. So, like I mentioned there’s no StreamSets Operator for Airflow, but you might be able to use our REST APIs or if you’re a customer the StreamSets SDK for Python.

Cheers,

Dash

 


Reply