Docker for MongoDB and Apache Spark.

An example of docker-compose to set up a single Apache Spark node connecting to MongoDB via MongoDB Spark Connector using JAVA.

** For demo purposes only **

You can start by running command :

docker-compose run java bash

Which would run the spark node and the mongodb node, and provides you with bash shell for the java spark instance.

From the spark instance, you could reach the MongoDB instance using mongodb hostname.

From the home dir /home/ubuntu, you should be able to compile the Java introduction file:

mvn package

Which should generate a jar file in the target directory. You can then execute using:

spark-submit --class tour.JavaIntroduction ./target/tour-1.0-SNAPSHOT.jar

See related article:

About

An example of docker compose to set up a single Spark node connecting to MongoDB via Spark Connector using JAVA

Language:Java 100.0%