--

Hi Rishabh,

Thanks for the informative feedback.

I agree with that. Like you said, the offset information for each consumer is stored in the Zookeeper.

But it is the duty of the consumer to commit the last read offset to Kafka as it reads messages. This is often called checkpointing.

If a consumer crashes, the next time it connects to Kafka, it can resume from the last committed checkpoint/offset as Kafka has that information.

Thanks,

Dunith

--

--

Dunith Danushka
Dunith Danushka

Written by Dunith Danushka

Editor of Tributary Data. Technologist, Writer, Senior Developer Advocate at Redpanda. Opinions are my own.

No responses yet