Hi Team
Can someone please suggest me a way to stop kafka topic using a jython or groovy-script
- Discovered Fame
- 16 replies
I mean pipeline consists of kafka-multi-topic as origin, It’s running infinitely.
- Headliner
- 258 replies
Kafka origin is a streaming type of origin and does not have events like no-more-data.
If you want to stop the pipeline on purpose then you can use
- Schedular Task: you can create a schedule to stop the job at a given time on schedule
- Use Orchestrator processor for calling StreamSets API to stop the job on some action
- Use an external system like Airflow, Control M, etc to call StreamSets API to stop the job.
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.