DSE Kafka Stockticks
The goal of this sample is to have a producer generate stock tick data and write to the tick-stream topic and then
have a consumer read from the topic and write the tick data to a Cassandra table.
Setup
First start Kafka and add the topic tick-stream following these basic instructions.
Download and start DSE.
Setup the Cassandra schema by running the SchemaSetup class.
Note: the keyspace replication settings use SimpleStrategy.
Modify as needed.
Running
Create the schema in DSE
mvn clean compile exec:java -Dexec.mainClass=com.datastax.tickdata.utils.SchemaSetup
Start the TickProducer with the desired number of events.
mvn clean compile exec:java -Dexec.mainClass=com.datastax.tickdata.producer.TickProducer
Start the TickConsumer.
mvn clean compile exec:java -Dexec.mainClass=com.datastax.tickdata.consumer.TickConsumer
Verification
You can run the following in cqlsh:
select * from datastax_tickdata_demo.tick_data ;
Reference: Patrick Callaghan's datastax-kafka-example.