confluentinc / parallel-consumer

Parallel Apache Kafka client wrapper with per message ACK, client side queueing, a simpler consumer/producer API with key concurrency and extendable non-blocking IO processing.

Home Page:https://confluent.io/confluent-accelerators/#parallel-consumer

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Exact continuous offset encoding for precise offset payload size back pressure

astubbs opened this issue · comments

Try encoding continuously so we always know how much is needed, and can switch of bringing in further messages dynamically until this required space shrinks.

Improvement upon #47, but #47 may suffice

Closing Issue