When resetting Kafka origin, the following error is displayed: "Origin 'Kafka Consumer' doesn't support reset operation".


Userlevel 3

Question:

When resetting Kafka origin, the following error is displayed: "Origin 'Kafka Consumer' doesn't support reset operation".  How come the reset operation is not supported?

 

Answer:

You cannot reset the origin for Kafka origins as the offsets for a consumer group are stored in Kafka ('__consumer_offsets' topic).  Resetting must be done on the Kafka brokers with the relevant command/API.  If your goal is simply to start from a new 'auto.offset.reset' value and don't care about re-using the pre-existing consumer group, then you can just specify a new consumer group in the Kafka origin configuration and restart the pipeline.


0 replies

Be the first to reply!

Reply