-
Download kafka into working directory first.
- Go to https://kafka.apache.org/downloads,
- Download the latest one.
- Extract it to the working dir.
- Rename it as
kafka.
-
Change the parameters in config.sh if needed (i.e. java path).
-
Run Zookeeper
. ./run_zookeper.sh
- Run Kafka
. ./run_kafka.sh
- Create Topic
. ./create_topic.sh {topic_name}
- List Topics
. ./list_topics.sh
- Open console to produce messages in a given topic
. ./start-producer-console.sh {topic_name}
- Open console to see the produced messages in a given topic
. ./start-consumer-console.sh {topic_name}
# run before run_zookeper.sh
export KAFKA_OPTS="-Djava.security.auth.login.config=`pwd`/kafka/config/zookeeper_jaas.conf"
# run before run_kafka.sh
export KAFKA_OPTS="-Djava.security.auth.login.config=`pwd`/kafka/config/kafka_server_jaas.conf"
# run before any client
export KAFKA_OPTS="-Djava.security.auth.login.config=`pwd`/kafka/config/kafka_client_jaas.conf"
Sources:
http://cloudurable.com/blog/kafka-tutorial-kafka-from-command-line/index.html
http://kafka.apache.org/documentation.html#uses_messaging