confluentinc / parallel-consumer

Parallel Apache Kafka client wrapper with per message ACK, client side queueing, a simpler consumer/producer API with key concurrency and extendable non-blocking IO processing.

Home Page:https://confluent.io/confluent-accelerators/#parallel-consumer

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Enhanced retry epic

astubbs opened this issue · comments

  • Basic retry options - customise message failure retry delay - currently 1 seconds, enable/disable retry
  • Retry max reached skip die or dlq or skip? #196
  • Retry failure callback (instead or as well as DQL) implemented in #92
  • #242
  • DLQ #310

Strongly related to #34 - Monitor for progress and optionally shutdown (leave consumer group), skip message or send to DLQ #34

BTW @ismarslomic , did you see ParallelConsumerOptions#defaultMessageRetryDelay? Do you think there should be more documentation around it?

I've added some docs - see 917e469

@radoslawtwardy -> #82 Custom retry delay duration from supplier function #82

Custom retry delay duration from supplier function

Possibility to define custom function will be great.

Custom retry delay duration from supplier function

Possibility to define custom function will be great.

Great! Try out master...astubbs:retry-delay-generator-func linked from the issue and let me know what you think of the api and functionality.

Failed count available through headers: #197

Closing Issue