cherusk / docker-compose-airflow

Docker Compose Apache Airflow (Official Docker Images) with CeleryExecutor, InitDB and InitUser

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

docker-compose-airflow

Docker Compose Apache Airflow (Official Docker Images) with CeleryExecutor, InitDB and InitUser

Ideal for local development or small scale personal deployments.

How to deploy:

Step 1: Clone this Repo and open terminal

Step 2: Go through .env file, init_airflow_setup.sh, docker-compose.yml file to change settings according to your preference. Or you can just keep them as it is for local development.

Step 3: Run docker-compose up -d

Step 4: Run sh init_airflow_setup.sh (Run this only for initial deployment)

Step 5: Go to http://localhost:8080 and login with user: airflow_test_user and password: airflow_test_password as specified in init_airflow_setup.sh script

Step 6: Run few dags and monitor Celery workers at http://localhost:5555

About

Docker Compose Apache Airflow (Official Docker Images) with CeleryExecutor, InitDB and InitUser

License:Apache License 2.0


Languages

Language:Python 73.9%Language:Shell 26.1%