Analyzing IoT Data with Storm, Kafka and Spark
This is a reference app for Internet of Things (IoT) use cases, built around the following tools from the Hortonworks Data Platform: Storm, Kafka, Spark, HBase, and Hive. Here are the steps to install this app on the HDP Sandbox.
Videos on the demo available here:
- Arun's Hadoop Summit 2015 keynote
- Shaun/George's Hadoop Summit 2014 Keynote
- Nauman's Demo at Phoenix Data conference 2014
Deployment options
- Deploy on Ambari installed HDP cluster (local or cloud)
- Deploy on sandbox VM
- Download the HDP 2.3 Sandbox from here
- Start the Sandbox, and add its IP address into your local machine's /etc/hosts file:
$ sudo echo "172.16.139.139 sandbox.hortonworks.com" >> /etc/hosts
Setup
- Option 1: script setup
- clone the git and run setup scripts using instructions in SETUP.md
$ ssh root@sandbox.hortonworks.com
$ cd
$ git clone https://github.com/hortonworks-gallery/iot-truck-streaming- Option 2: Ambari setup
- deploy using Ambari service using instructions from https://github.com/abajwa-hw/iotdemo-service