Skip to main content

When resetting Kafka origin, the following error is displayed: "Origin 'Kafka Consumer' doesn't support reset operation".


AkshayJadhav
StreamSets Employee
Forum|alt.badge.img

Question:

When resetting Kafka origin, the following error is displayed: "Origin 'Kafka Consumer' doesn't support reset operation".  How come the reset operation is not supported?

 

Answer:

You cannot reset the origin for Kafka origins as the offsets for a consumer group are stored in Kafka ('__consumer_offsets' topic).  Resetting must be done on the Kafka brokers with the relevant command/API.  If your goal is simply to start from a new 'auto.offset.reset' value and don't care about re-using the pre-existing consumer group, then you can just specify a new consumer group in the Kafka origin configuration and restart the pipeline.

Did this topic help you find an answer to your question?

Reply