aerjotl / ambari-airflow-mpack

Ambari stack service for installing and managing Apache Airflow on HDP cluster

Apache Airflow management pack for Apache Ambari (airflow-ambari-mpack)

Mpack allows you to install/configure airflow directly from ambari. Apache Airflow version included: 1.10.0

Installing Apache Aiflow Mpack:

1. Stop Ambari server.
2. Install the Apache Airflow Mpack on Ambari server.
3. Start Ambari server.

ambari-server stop
ambari-server install-mpack --mpack=airflow-service-mpack.tar.gz
ambari-server start

Upgrading Apache Aiflow Mpack:

1. Stop Ambari server.
2. Upgrade the Apache Airflow Mpack on Ambari server.
3. Start Ambari server.

ambari-server stop
ambari-server upgrade-mpack --mpack=airflow-service-mpack.tar.gz
ambari-server start

Installing Apache Airflow from Ambari:

1. Action - Add service.
2. Select Apache Airflow service.
3. Choose destination server.
4. You may configure Apache Airflow, change home folder.
5. Deploy!

Virtual environment support

If you want to run apache airflow in virtual environment, you should modify startup script "AIRFLOW_HOME/airflow_control.sh".

Example:

#!/bin/bash

export AIRFLOW_HOME=/usr/local/airflow/airflow/ && source /usr/local/airflow/airflow_venv/airflow/bin/activate && /usr/local/airflow/airflow_venv/airflow/bin/airflow $1 --pid /usr/local/airflow/airflow/airflow-sys-$1.pid

Enjoy!