aliraja-dev / cs5614-assignment4

Apache Spark and Kafka Streaming Application

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

CS5614 Assignment 4

Run the following commands to get started. We assume you have python 3.0+ set up on your machine.

python -m pip install kafka-python

docker compose -f ./docker-compose-expose.yml up --detach

Wait for the docker containers to start, then run:

python ./producer.py

If all goes well you should see the following output

Sent 1 dummy value(s) to topic_test
Sent 2 dummy value(s) to topic_test
Sent 3 dummy value(s) to topic_test
...

About

Apache Spark and Kafka Streaming Application

License:Apache License 2.0


Languages

Language:Shell 70.0%Language:Jupyter Notebook 20.7%Language:Dockerfile 6.3%Language:Python 2.9%