OMR5221 / python-kafka-avro-test

Created fully dockerized project of the Blog posts listed in ReadMe

python-avro-producer

For a tutorial on how this repository was built and how it works, go to this article (for Avro Producer part) and this (for Avro Consumer part).

Updated to move producer/consumer into separate docker-compose files:

• Step 1: Launch local Kakfa Cluster with Control Center and Schema Registry:

$ docker-compose -f docker-compose.kafka.yml up -d

• Step 2: Launch Producer to send Avro files to Kafka Topic create-user-request:

$ docker-compose -f docker-compose.producer.yml up -d

• Step 3: Launch Consumer to ingest messages produced to Topic create-user-request:

$ docker-compose -f docker-compose.consumer.yml up -d

Teardown

• Stop the containers:

$ docker-compose -f docker-compose.consumer.yml down
$ docker-compose -f docker-compose.producer.yml down
$ docker-compose -f docker-compose.kafka.yml down

• Remove images (Not associated to a container): ``bash $ docker image prune -a

- Remove volume (not associated to a container):
``bash
$ docker volume prune