noizo / KafkaOnEC2

Ansible scripts for deploying Kafka on EC2

Kafka on EC2

Ansible scripts for deploying Kafka (v0.9.1 with Zookeeper 3.4.6) on EC2. These scripts were developed based on various resources from Internet. Below is the main reference:

• Ansible Playbook - Setup Kafka Cluster

How To Run

Prerequisites

• Ansible
• boto - required for Ansible EC2 module
• Setup boto configuration based on http://boto.readthedocs.org/en/latest/boto_config_tut.html
• Access to EC2 Key Pair

Steps

1. Edit configuration file group_vars/all based on your reqiurements and environment.
2. Execute ansible-playbook --private-key=<AWS_key_file> -u ubuntu kafka.yml

Notes

• In one of my Macs I got the error described in ansible/ansible#5734. If you are getting the same error please use the inventory file provided (ansible-playbook --private-key=<AWS_key_file> -u ubuntu -i inventory kafka.yml).