chaordic / ansible-role-airflow

Ansible role to install Apache Airflow

Apache Airflow Ansible role

This ansible role installs a Apache Airflow server in a Debian/Ubuntu environment.

• Getting Started
  • Prerequisities
  • Installing
• Usage
• Testing
• Built With
• Versioning
• Authors
• License
• Contributing

Getting Started

These instructions will get you a copy of the role for your ansible playbook. Once launched, it will install a Apache Airflow server in a Debian or Ubuntu system.

Prerequisities

Ansible 2.3.3.0 version installed. Inventory destination should be a Debian or Ubuntu environment.

For testing purposes, Molecule with Docker as driver.

Installing

Create or add to your roles dependency file (e.g requirements.yml) from GitHub:

- src: http://github.com/idealista/airflow-role.git
  scm: git
  version: 1.7.2
  name: airflow

or using Ansible Galaxy as origin if you prefer:

- src: idealista.airflow-role
  version: 1.7.2
  name: airflow

Install the role with ansible-galaxy command:

ansible-galaxy install -p roles -r requirements.yml -f

Use in a playbook:

---
- hosts: someserver
  roles:
    - { role: airflow }

Usage

Look to the defaults properties file to see the possible configuration properties.

Bear in mind that, starting with Airflow v1.10.0, PyPi package pyasn1 v0.4.4 is needed. To install it:

airflow_required_python_packages:
  - {name: pyasn1, version: 0.4.4}

airflow_extra_packages (available at: https://airflow.apache.org/installation.html#extra-packages) should be a list following this format:

airflow_extra_packages:
  - celery
  - mysql

Testing

pipenv install -r test-requirements.txt --python 2.7
pipenv run molecule test

Built With

Versioning

For the versions available, see the tags on this repository.

Additionaly you can see what change in each version in the CHANGELOG.md file.

Authors

• Idealista - Work with - idealista

See also the list of contributors who participated in this project.

License

This project is licensed under the Apache 2.0 license - see the LICENSE file for details.

Contributing

Please read CONTRIBUTING.md for details on our code of conduct, and the process for submitting pull requests to us.