Does StreamSets Data Collector and Transformer support integration with Airlfow? Could you please share details on the integration? i.e. Prebuild StreamSets Operator for Airflow
Best answer by Dash
View originalDoes StreamSets Data Collector and Transformer support integration with Airlfow? Could you please share details on the integration? i.e. Prebuild StreamSets Operator for Airflow
Best answer by Dash
View originalHi
There is no StreamSets Operator for Airflow. What’s your use case?
Dear @Dash
We use airflow as the orchestration tool and it needs to integrate with StreamSets Data Collector / Transformer for a set of steps. Wanted to understand approach for integrating airflow with StreamSets.
Regards
Varadha
Hey
Got it. So, like I mentioned there’s no StreamSets Operator for Airflow, but you might be able to use our REST APIs or if you’re a customer the StreamSets SDK for Python.
Cheers,
Dash
Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.