hoat23 / DataEngineering

Instalation and uses cases of Jupiter by data analitics

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

DATA ENGINEERING

This repository is for a quick installation and configuration of software using Docker.

Docker commands

Steps to create a container Docker.

  • Create an image from a Dockerfile using docker build.

  • Create a container layer from an image, use the command docker create.

  • Finally, after you have launched a container from an existing image, you start its service and run the application.

Listing all images

docker images ps

Docker run "centos". Running a "centos" image.

docker run -it centos

Docker build a image from a files configuration.

docker build -t docker-hadoop docker-hadoop

If you have problems with connection to internet, add the command: --network=host

Docker remove all stopped containers, dangling images, and unused network. Use the -f or --force option to bypass the prompt. By default, the command doesn’t remove unused volumes to prevent losing important data. To remove all unused volumes, pass the --volumes option

docker system prune

Docker remove image (f:force), especify using repository:tag or image_id

docker image rmi -f hadoop-docker:1.0

Starting a "centos" container.

docker start "centos".

Listing all containers.

docker ps -a

Docker online: https://labs.play-with-docker.com

Hadoop Configuration in Docker

Spark Configuration in Docker

Elasticsearch configuration in Docker

Logstash configuration in Docker

Kibana configuration in Docker

Architectures in AWS

Dataframes with Javascript

MongoDB

Scala

About

Instalation and uses cases of Jupiter by data analitics

License:GNU General Public License v3.0


Languages

Language:Dockerfile 61.6%Language:Python 32.8%Language:Shell 4.5%Language:Batchfile 1.1%