This project sets up a local Kafka cluster with Zookeeper, Confluent Control Center, Confluent Rest Proxy, and Confluent Schema Registry.
Also included:
- Kafka Tools (CLI tools) for administration
- Ensure Docker and Docker Compose are installed
- Build the Docker containers.
docker compose build
- One-time set-up (or if you want to generate new secrets)
./auto/create-certs.sh
- Bring the cluster up.
./auto/up.sh
Note: By default, some services like kafka-tools
is scaled down as they are not useful to be up as a service.
See below to learn more about running kafka-tools
for admin tasks.
./auto/logs.sh
./auto/down.sh
- To access the Control Center, visit http://localhost:9021
- To access the Rest Proxy, interact with http://localhost:8082
- Broker is available at
localhost:19092
./auto/kafka-tools.sh <tool-name> <arguments>
# Note that the broker is available at "broker:29092"
# Example, list all topics
./auto/kafka-tools.sh kafka-topics --command-config /etc/kafka/config/command.properties --bootstrap-server broker.local:19092 --list
# Example, create a topic
./auto/kafka-tools.sh kafka-topics --bootstrap-server=broker.local:19092 --command-config /etc/kafka/config/command.properties --create --topic UserEmail --partitions 1 --replication-factor 1
# Example, delete a Topic
./auto/kafka-tools.sh kafka-topics --bootstrap-server=broker.local:19092 --command-config /etc/kafka/config/command.properties --delete --topic UserEmail
-