best-practice-and-impact / python-pipeline-runner

A Python data pipeline runner

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

python-pipeline-runner

Currently some concepts for a Python data pipeline runner

dag_approaches contains a couple of attempts at building a config-driven DAG pipeline runner.

native_python_example contains a working example that relies on Python to procedurally validate object references at runtime, instead of building a DAG ourselves.

About

A Python data pipeline runner

License:MIT License


Languages

Language:Python 100.0%