PKOfficial/activator-kstream-kafka

#Kafka Stateful Stream Processor

This is an activator project showcasing stateful stream processing using Kafka KStream.

Kafka Client for Kafka API

Twitter4J Streaming as a source.

Typesafe Config to read configuration file.

Kafka Streaming to process stream

###Steps to Install and Run Zookeeper and Kafka on your system :

Step 1: Download Kafka

Download Kafka from here

Step 2: Extract downloaded file

tar -xzvf kafka_2.11-0.10.1.1.tgz
cd kafka_2.11-0.10.1.1

Step 3: Start Servers

Start Zookeeper:

bin/zookeeper-server-start.sh config/zookeeper.properties

Start Kafka server:

bin/kafka-server-start.sh config/server.properties

###Clone Project

git clone git@github.com:knoldus/activator-stateful-kstream-kafka.git
cd activator-kstream-kafka
bin/activator clean compile

###Start Tweet Producer

bin/activator "run-main com.knoldus.demo.ProducerDemo"

This will start fetching tweets and push every tweet into the Kafka queue.

###Start Stream Processor

bin/activator "run-main com.knoldus.demo.KStreamDemo"

This will start stream processing.

###Start Consumer

bin/activator "run-main com.knoldus.demo.ConsumerDemo"

This will start hashtag count.

For any issue please raise a ticket @ Github Issue

PKOfficial / activator-kstream-kafka