facundobianco / docker-hadoop-client

Client for Hadoop (hdfs shell). Also includes support for Kerberos authentication

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Docker container for Hadoop client

It's a simple client for Hadoop using the Hadoop Shell. Also includes support for Kerberos authentication.

The Hadoop version is 2.7.1 that corresponds to HDP 2.4.2.

Before to build

Configure the file core-site.xml.

For Keberos authentication you can mount the file with the Docker option

-v /etc/krb5.conf:/etc/krb5.conf:ro

How to run it

mkdir ${HOME}/data
docker run --name hadoop -v ${HOME}/data:/home/hadoop/data \
    --add-host hdfs.example.com:10.0.0.1 \
    -it hadoop

About

Client for Hadoop (hdfs shell). Also includes support for Kerberos authentication