Skip to main content

When resetting Kafka origin, the following error is displayed: "Origin 'Kafka Consumer' doesn't support reset operation".

  • May 23, 2022
  • 0 replies
  • 39 views

AkshayJadhav
StreamSets Employee
Forum|alt.badge.img

Question:

When resetting Kafka origin, the following error is displayed: "Origin 'Kafka Consumer' doesn't support reset operation".  How come the reset operation is not supported?

 

Answer:

You cannot reset the origin for Kafka origins as the offsets for a consumer group are stored in Kafka ('__consumer_offsets' topic).  Resetting must be done on the Kafka brokers with the relevant command/API.  If your goal is simply to start from a new 'auto.offset.reset' value and don't care about re-using the pre-existing consumer group, then you can just specify a new consumer group in the Kafka origin configuration and restart the pipeline.