DataLearns / awesome-duckdb

🦆 A curated list of awesome DuckDB resources

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Awesome DuckDB Awesome

A curated list of awesome DuckDB libraries, tools and resources.

DuckDB is an in-process SQL OLAP database management system.

Contents

Resources

Tools Powered by DuckDB

  • Rill Developer - Tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL.
  • Ibis Project - The flexibility of Python analytics with the scale and performance of modern SQL.
  • MotherDuck - Supercharge DuckDB experience with the cloud.
  • Boiling Data - Serverless data analytics overlay on top of S3 Data Lakes.
  • Hex Dataframe SQL - Hex's Dataframe SQL cells are powered by DuckDB.
  • Mode - Mode uses DuckDB for their in-memory data engine.
  • VulcanSQL - DuckDB can be used as a caching layer or a data connector in VulcanSQL, a Data API framework for data folks to create REST APIs by writing SQL templates.
  • Tad - A fast, free, cross-platform tabular data viewer application powered by DuckDB.
  • Honeycomb Maps - A browser-based geospatial analysis tool leveraging DuckDB Wasm.
  • Bauplan - A serverless data transformation platform for data lakes.
  • Excalichart.com - A fast, free dashboard for exploring your data.

Libraries Powered by DuckDB

  • Mosaic - An extensible framework for linking databases and interactive views.
  • Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

SQL Clients and IDE that Support DuckDB

  • Harlequin - The DuckDB IDE for your terminal. (GitHub).
  • qStudio - A free SQL tool specialized for data analysts. It runs on every operating system and allows easy browsing of tables and charting of results.
  • DuckDB SQL Tools - Free DuckDB SQL Tools for VS Code IDE. Premium version available with advanced features.

Projects Powered by DuckDB

  • NBA Monte Carlo - Monte Carlo simulation of the NBA season, leveraging Meltano, dbt, DuckDB and Evidence.
  • Datadex - Open source and local friendly data platform to collaborate on Open Data using DuckDB, Dagster, dbt, and Quarto.

Integrations

Extensions

  • Official Extensions - Official DuckDB extensions.
    • arrow - A zero-copy data integration between Apache Arrow and DuckDB.
    • postgres_scanner – Allows DuckDB to directly read data from a running Postgres instance.
    • spatial - Enables geospatial processing.
    • sqlite_scanner – To read and write to SQLite databases.
    • duckdb_iceberg - DuckDB extension for reading Iceberg tables.
  • Deltatable - DuckDB extension for reading Delta tables.
  • Lance - Integrate Lance (modern columnar data format for ML implemented in Rust) with DuckDB.
  • PRQL - Run PRQL commands directly within DuckDB.
  • duckdb-engine - SQLAlchemy driver for DuckDB.
  • Scrooge-McDuck - DuckDB extension to support a set of aggregation functions and data scanners on financial data.
  • duckdb-pytables - DuckDB extension to allow running SQL on arbitrary data sources.
  • ODBC Scanner DuckDB Extension - DuckDB extension to read data directly from databases supporting the ODBC interface.

Media

Talks

Podcasts

Blog Posts

Contribute

Contributions welcome! Read the contribution guidelines first.

About

🦆 A curated list of awesome DuckDB resources

License:Creative Commons Zero v1.0 Universal