cyyeh / awesome-duckdb

🦆 A curated list of awesome DuckDB resources

Awesome DuckDB

A curated list of awesome DuckDB libraries, tools and resources.

DuckDB is an in-process SQL OLAP database management system.

Contents

• Resources
• Tools Powered by DuckDB
• Integrations
• Extensions
• Media
  • Talks
  • Podcasts
• Contribute

Resources

• Official Documentation - Official DuckDB documentation.
• Official Blog - Official DuckDB blog.
• DuckDB Clients - Client APIs for DuckDB.
• docker-duckdb - Docker image for DuckDB CLI.
• DuckDB setup - GitHub Action to install DuckDB in CI.
• Online DuckDB Shell - Online DuckDB shell powered by WebAssembly.

Tools Powered by DuckDB

• Rill Developer - Tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL.
• Ibis Project - The flexibility of Python analytics with the scale and performance of modern SQL.
• MotherDuck - Supercharge DuckDB experience with the cloud.
• Boiling Data - Serverless data analytics overlay on top of S3 Data Lakes.
• Hex Dataframe SQL - Hex's Dataframe SQL cells are powered by DuckDB.
• Mode - Mode uses DuckDB for their in-memory data engine.
• VulcanSQL - DuckDB can be used as a caching layer or a data connector in VulcanSQL, a Data API framework for data folks to create REST APIs by writing SQL templates.

Libraries Powered by DuckDB

• Mosaic - An extensible framework for linking databases and interactive views.

Integrations

• dbt-duckdb - DuckDB dbt adapter.
• data load tool - DuckDB destination - Extract and load data from APIs to DuckDB using dlt.
• target-duckdb - Load data to DuckDB based on Singer spec.
• Airbyte DuckDB destination - Load data to DuckDB with Airbyte.
• Kestra DuckDB plugin — Run queries with DuckDB to schedule data transformations and process automations, and run event-driven anomaly detection pipelines.

Extensions

• Official Extensions - Official DuckDB extensions.
  • arrow - A zero-copy data integration between Apache Arrow and DuckDB.
  • postgres_scanner – Allows DuckDB to directly read data from a running Postgres instance.
  • spatial - Enables geospatial processing.
  • sqlite_scanner – To read and write to SQLite databases.
  • duckdb_iceberg - DuckDB extension for reading Iceberg tables.
• Deltatable - DuckDB extension for reading Delta tables.
• Lance - Integrate Lance (modern columnar data format for ML implemented in Rust) with DuckDB.
• PRQL - Run PRQL commands directly within DuckDB.
• duckdb-engine - SQLAlchemy driver for DuckDB.
• Scrooge-McDuck - DuckDB extension to support a set of aggregation functions and data scanners on financial data.
• duckdb-pytables - DuckDB extension to allow running SQL on arbitrary data sources.
• ODBC Scanner DuckDB Extension - DuckDB extension to read data directly from databases supporting the ODBC interface.

Media

Talks

• DuckDB: Bringing analytical SQL directly to your Python shell @ EuroPython - Pedro Holanda.
• DuckDB keynote @ Data + AI Summit 2023 - Hannes Mühleisen.
• DuckCon #3 playlist
• DuckDB: Bringing Analytical SQL Directly To Your Python Shell @ FOSDEM - Pedro Holanda.
• State Of The Duck @ DuckCon - Hannes Mühleisen & Mark Raasveldt.
• DuckDB Extensions @ DuckCon - Pedro Holanda & Sam Ansmink.
• Developing Systems in Academia: The Good, the Bad, and the not-so-Ugly Duckling @ CIDR - Hannes Mühleisen.
• DuckDB An Embeddable Analytical Database @ FOSDEM - Hannes Mühleisen.

Podcasts

• Software Engineering Daily: DuckDB - Hannes Mühleisen.
• Move Your Database To The Data And Speed Up Your Analytics With DuckDB - Hannes Mühleisen.
• The Personal Data Warehouse - Jordan Tigani.

Contribute

Contributions welcome! Read the contribution guidelines first.