fr33m0nk / clj-alpakka-kafka

Clojure wrapper over Alpakka Kafka

fr33m0nk/clj-alpakka-kafka

clj-alpakka-kafka is a simple library that wraps over Alpakka Kafka and offers convenience methods for easy implementation in Clojure code. For further documentation, do refer Alpakka Kafka official docs.

Usage

Functions are divided in following namespaces:

• fr33m0nk.akka.actor
  • Functions for working with Akka Actor System
• fr33m0nk.akka.restart-source
  • Functions for working with Restart Sources
  • Used for adding fault tolerance and resiliency
• fr33m0nk.akka.stream
  • Functions for working with Akka source and flow streams
  • Only frequently used functions are mapped right now
• fr33m0nk.alpakka-kafka.consumer
  • Functions for working with Alpakka Kafka Consumer Source and ConsumerControl
• fr33m0nk.alpakka-kafka.producer
  • Functions for working with Alpakka Kafka Producer Sink and Flow
• fr33m0nk.alpakka-kafka.committer
  • Functions for working with Alpakka Kafka Committer Sink
• fr33m0nk.alpakka-kafka.transactional
  • Functions for building Transaction pipelines using Transactional Source and Sink

Add the following to your project dependencies:

• CLI/deps.edn dependency information

net.clojars.fr33m0nk/clj-alpakka-kafka {:mvn/version "0.1.8"}

• Leningen/Boot

[net.clojars.fr33m0nk/clj-alpakka-kafka "0.1.8"]

• Maven

<dependency>
  <groupId>net.clojars.fr33m0nk</groupId>
  <artifactId>clj-alpakka-kafka</artifactId>
  <version>0.1.8</version>
</dependency>

• Gradle

implementation("net.clojars.fr33m0nk:clj-alpakka-kafka:0.1.8")

Additional dependencies:

• Kafka Client (any compatible version is fine)

org.apache.kafka/kafka-clients {:mvn/version "3.6.1"} 

• SLF4J implentation based logger
  • Needed for Akka logging

com.taoensso/timbre {:mvn/version "6.1.0"}
com.fzakaria/slf4j-timbre {:mvn/version "0.3.21"}

Examples

1. Using Alpakka Kafka stream with a sink
2. Using Alpakka Kafka stream with a Kafka Producer
3. Using Alpakka Kafka stream and producing multiple records per consumer record
4. Using Alpakka Kafka stream with At-Least-Once Delivery
5. Using Alpakka Kafka stream with Error handling
6. Using Alpakka Kafka stream with Transactional Source and Sink

License

Copyright © 2023 Prashant Sinha

Distributed under the MIT License.