big-data-europe / docker-hadoop-spark-workbench

[EXPERIMENTAL] This repo includes deployment instructions for running HDFS/Spark inside docker containers. Also includes spark-notebook and HDFS FileBrowser.

big-data-europe/docker-hadoop-spark-workbench Issues

There are 1 datanode(s) running and 1 node(s) are excluded in this operation
Updated 2 years ago13
TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
Updated 3 years ago
NoReverseMatch: u'about' is not a registered namespace
Closed 3 years ago
java.lang.NumberFormatException: For input string: "tcp://10.153.3.65:8080"
Updated 3 years ago
Unable to query the hive table in container from spark-shell running in Windows
Updated 4 years ago
beeline
Updated 4 years ago
Job aborted due to stage failure while reading a simple Text File from HDFS
Updated 4 years ago4
spark cannot read file in hadoop in overlay network(swarm mode)
Updated 4 years ago2
swarm makefile traefik:1.7 syntax
Updated 5 years ago
How to read data into Spark from HDFS?
Updated 5 years ago1
Directory /hadoop/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible.
Updated 5 years ago
Great repo! But how can we use Pyspark?
Updated 5 years ago2
java.lang.IllegalArgumentException: java.net.UnknownHostException: namenode
Updated 5 years ago2
pyspark
Closed 5 years ago
can not open Spark-notebook: http://localhost:9001
Updated 5 years ago1
error in spark notebook
Updated 6 years ago
Why HDFS run without YARN ?
Closed 6 years ago1
incompatible clusterID Hadoop
Updated 6 years ago4
How to add a file from local file system?
Updated 6 years ago1
Faile to connect to namenode:8020
Updated 6 years ago1
Global Values not found
Closed 6 years ago2
Spark Worker not connected to Spark Master
Closed 6 years ago2
GlusterFS?
Updated 6 years ago1
org.apache.hadoop.hdfs.server.common.IncorrectVersionException
Closed 6 years ago2
latest version of hue and hue.ini in volume
Closed 6 years ago2
java.net.UnknownHostException: namenode
Closed 6 years ago1
Question: how to connect from external client (intellij) to spark?
Closed 6 years ago4
links to any official mailing lists /chats/etc.
Closed 6 years ago1
Binding 8081 port error when I execute scale up
Closed 6 years ago4
sparkContext not found in spark notebook
Closed 6 years ago1
docker-compose scale spark-worker=3 & spark-submit
Closed 6 years ago2
command: ["./wait-for-it.sh"] for swarm mode
Closed 6 years ago3
Switch spark-notebook to apache zeppelin
Closed 6 years ago6
Question: how can i run hdfs command line commands such as "hdfs dfs fs -ls"
Closed 6 years ago1
Q: How can you scale out on multiple hosts?
Closed 6 years ago5
ClassCastException while running example from BDE2020 blog
Closed 7 years ago1
How do i get my hadoop home directory?
Closed 7 years ago5
General Questions - Multihost, Spark Version and Apache Zeppelin
Closed 7 years ago12
How to enable Pyspark in Jupyter Notebook
Closed 7 years ago2
Steps compatible to Windows?
Closed 7 years ago2
Override SPARK_MASTER and SPARK_MASTER_PORT env variables
Closed 7 years ago2
Any way to run this in swarm mode?
Closed 7 years ago7
MapReduce jobs causes Namenode to stop
Closed 7 years ago4
Copying files to HDFS
Closed 7 years ago4
Failed on Connection Exception
Closed 7 years ago2
Error when accessing hdfs file from remote spark driver
Closed 7 years ago1
Hue is not working
Closed 7 years ago1
Broken hadoop package - missing GLIBC_2.14
Closed 7 years ago3
Connect spark-notebook to spark cluster
Closed 8 years ago3
Unable to view worker details or Jobs
Closed 8 years ago3