Question:
How to send pipeline events like start, stop, etc. as messages to a Kafka topic?
Answer:
SDC exposes WebSockets endpoint 'ws://localhost:18630/rest/v1/webSocket?type=status' for SDC pipeline ptatus change events (STARTING, RUNNING, STOPPING, STOPPED, ...). So, a pipeline can be created with WebSocket Client Origin -> Kafka Producer Destination to send all pipeline events as Kafka Message to a Kafka topic.
The attached sample pipeline illustrates that use case.
Related JIRA:
