jamesattard / docker-kafka-cluster

Multi Node Kafka Cluster Setup Using Docker

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Multi Node Kafka Cluster Setup Using Docker

This configuration builds a docker container to run a x3 node Kafka cluster powered by x3 Zookeeper nodes. This project is based on the official Confluent Kafka image.

Configuration

Configuration is pretty straightforward - since this is a multi-node cluster, I kept the same ports throughout (because I can!). Long live Docker v3 as it allowed me to attach private network as well (ergo, no need for a DNS server).

Run Kafka Cluster

$ docker-compose up -d

This will spawn x6 Docker Containers (x3 Kafka + x3 Zookeeper) and another proxy container should you need to have direct access to any of these containers.

Demo

Kafka1

Kafka2

Kafka3

About

Multi Node Kafka Cluster Setup Using Docker