puckel / docker-azkaban

Azkaban stack

Azkaban Dockerfiles

Azkaban is a batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy to use web user interface to maintain and track your workflows. Azkaban consists of 3 key components:

• Relational Database (MySQL)
• AzkabanWebServer
• AzkabanExecutorServer

This repository contains Dockerfiles of Azkaban for Docker.

Base Docker Image

• Official java:8

Installation

1. Install Docker.

2. Install Docker-compose.

3. Download automated builds

azkaban-webserver from public Docker Hub Registry: docker pull puckel/docker-azkaban-webserver

azkaban-executor from public Docker Hub Registry: docker pull puckel/docker-azkaban-executor

Alternatively, you can build an image from Dockerfile.

Usage

docker-compose up -d
docker-compose ps

The repository contains a shell script to test the azkaban stack: testing/test_api.sh (require jq).