eocode / Airflow

repository-with-airflow-implementation

Create VENV

python -m venv env

# .env file
AIRFLOW_UID=1000
AIRFLOW_GID=0

Install airflow

pip install "apache-airflow[celery]==2.4.3" --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-2.4.3/constraints-3.7.txt"

Manage commands

docker exec -it airflow_airflow-worker_1 bash

Test a task

airflow tasks test process_user create_table 2022-11-29

Configurations

airflow.cfg

airflow config get-value core sql_alchemy

airflow config get-value core executor