arconsis / Eshop-EDA

Event driven microservices showcase. E-shop workflow based on event driven communication using Kafka

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

V2: Check if we need to store offset in consumers database together with our model in a transaction

eldimious opened this issue · comments

Verify that we have idempotent consumer

  • Check if need to store offset in consumers database together with our model in a transaction
  • Check if need to update offset on kafka after transaction completed

https://stackoverflow.com/questions/58255598/kafka-is-it-good-practice-too-keep-topic-offset-in-database

https://medium.com/@shesh.soft/kafka-idempotent-producer-and-consumer-25c52402ceb9

https://www.linkedin.com/pulse/kafka-idempotent-consumer-transactional-outbox-rob-golder/ (offset is updated on kafka after transaction is completed --- manual commit)