Spark Playground
This vagrant box will install a single-instance Apache Spark 2.0.0, on Ubuntu 14.04, with JDK 8.
To start the vagrant box, simply install Vagrant and VirtualBox, then run this command:
vagrant up
This will set up a virtual machine with the following configurations:
- Ubuntu 14.04
- Apache Spark 2.0.0
- JDK 8
- All spark ports are mapped to local ports on host machine
The Spark is installed under path /spark
Start Spark
- Login to the virtual machine:
vagrant ssh
- Start Spark cluster
/spark/sbin/start-all.sh
-- You may need to enter the user password for "vagrant", which is default to "vagrant".
-
Verify Spark is started and healthy Go to local browser and browse to
http://localhost:8081. The Spark web UI should show up. -
See "netflow" folder (http://beeyeas.blogspot.com/2017/06/network-traffic-analysis.html) contains nfsen-1.3.8.tar.gz - Installer downloaded from https://github.com/sown/nfsen
nfsen-bin.tar.gz - Binary folder installed into this vagrant VM , serving netflow nfsen live simulated traffic graphs - MUST to exploded into /var/nfsen folder in any VM
rrdtool-1.4.3.tar.gz - rrd tool for perl