kyaukyuai / jaffle_shop_duckdb_superset

Modern Data Stack in a box with dbt-duckdb and Apache Superset

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

jaffle_shop_duckdb_superset


This is a simple project using dbt-duckdb and Apache Superset to build an all-in-one Modern Data Stack which can be used on your laptop without Cloud Stacks.

It's inspired by this article: Modern Data Stack in a Box with DuckDB. The specific configuration for implementation is as follows. This time, the focus is on simplification, and parts such as ORCHESTRATION and INGESTION are omitted. Considering the developer productivity in a local environment, ORCHESTRATION is unnecessary, and for INGESTION, DuckDB's httpfs or scanner extension is considered sufficient. Of course, it is possible to expand as necessary.

Modern Data Stack in a Box

Requirements

Setup

Just 2 steps!

  1. Rename .env.example file to .env and set your desired password. Remember to never commit files containing passwords or any other sensitive information.

  2. With Docker engine and Docker-Compose installed, change directory to the root folder of the project (also the one that contains docker-compose.yml) and run.o

    docker-compose up --build

Screenshots

Apache Superset

Apache Superset

dbt

Overview Lineage Graph

References

About

Modern Data Stack in a box with dbt-duckdb and Apache Superset

License:MIT License


Languages

Language:Dockerfile 50.8%Language:Shell 49.2%