daviddwlee84 / Prefect-Integrations

Show case of buttons (Streamlit) trigger pipeline and monitor executions in Prefect.

Prefect Integrations

Show case of buttons trigger pipeline and monitor executions in Prefect.

Install Dependencies

pip install -r requirements.txt

Start Self-hosted Prefect Server

$ prefect server start

 ___ ___ ___ ___ ___ ___ _____ 
| _ \ _ \ __| __| __/ __|_   _| 
|  _/   / _|| _|| _| (__  | |  
|_| |_|_\___|_| |___\___| |_|  

Configure Prefect to communicate with the server with:

    prefect config set PREFECT_API_URL=http://127.0.0.1:4200/api

View the API reference documentation at http://127.0.0.1:4200/docs

Check out the dashboard at http://127.0.0.1:4200

Set server communication

prefect config set PREFECT_API_URL=http://127.0.0.1:4200/api

Examples

With Streamlit

streamlit run ./WithStreamlit/example.py

Goto http://localhost:8501 and press button

With Flask

python ./WithFlask/app.py

Goto http://127.0.0.1:5000/ and press button

Resources

• PrefectHQ/prefect: Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

Trouble Shooting

• task - TypeError: 'fn' must be callable (Prefect - Python) - Stack Overflow

Some resource on the internet might use Prefect V1.0 syntax, be careful.