ivanfoong / dagster-duckdb-example

Based on https://dagster.io/blog/duckdb-data-lake

Setup

pip install dagster pandas duckdb sqlescapy html5lib lxml dagit pytest localstack awscli awscli-local

Get Started

dagit

Schedules and sensors

dagster-daemon run

Unit Testing

pytest jaffle_tests

Based on https://dagster.io/blog/duckdb-data-lake