Question

StreamSet Data Collector Kafka Multi Topic Consumer

  • 4 July 2023
  • 3 replies
  • 34 views

in the StreamSet Data Collector Kafka Multi Topic Consumer. I read that there is an option to configure the offset to earliest, latest or a particular timestamp

 

I have a requirement to set the offset to start from a particular timestamp.

 

Is there someone help me with how to achieve this or some examples?


3 replies

Userlevel 5
Badge +1

@mr_manii 

The time stamp only accept  in milliseconds. We need to provide the timestamp in milliseconds but i am not sure on it.

I need to dig into it.

 

Hi Bikram, thanks that helps

Additionally, I think we need to move the processing time to an earlier desired time based on the configuration with EPOCH_TIME

Userlevel 5
Badge +1

@mr_manii 

Nice to know it helps , please provide details how the epoch_time has been set.

 

Thanks & Regards

Bikram_

Reply