scrapinghub / storm-docker

Dockerfiles for building a storm cluster.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

storm-docker

Dockerfiles for building a storm cluster.

Based on https://github.com/wurstmeister/storm-docker. Inspired by https://github.com/ptgoetz/storm-vagrant

The images are available directly from https://index.docker.io

##Pre-Requisites

##Usage

Start a cluster:

  • docker-compose up

Destroy a cluster:

  • docker-compose stop

Add more supervisors:

  • docker-compose scale supervisor=3

##Building

  • docker build -t vshlapakov/storm:0.9.4 .

##FAQ

How can I access Storm UI from my host?

Take a look at docker-compose.yml:

ui:
  image: vshlapakov/storm:0.9.4
      ports:
        - "49080:8080"

This tells Docker to expose the Docker UI container's port 8080 as port 49080 on the host

If you are running docker natively you can use localhost. If you're using boot2docker, then do:

$ boot2docker ip
The VM's Host only interface IP address is: 192.168.59.103

Which returns your docker VM's IP.
So, to open storm UI, type the following in your browser:

localhost:49080

or

192.168.59.103:49080

in my case.

How can I deploy a topology?

Since the nimbus host and port are not default, you need to specify where the nimbus host is, and what is the nimbus port number.
Following the example above, after discovering the nimbus host IP (could be localhost, could be our docker VM ip as in the case of boot2docker), run the following command:

storm jar target/your-topology-fat-jar.jar com.your.package.AndTopology topology-name -c nimbus.host=192.168.59.103 -c nimbus.thrift.port=49627

How can I connect to one of the containers?

Find the container id for the container you wish to connect to (use docker-compose ps)

$ docker exec -it CONTAINER_ID bash

About

Dockerfiles for building a storm cluster.


Languages

Language:Shell 100.0%