duckdb

There are 14 repositories under duckdb topic.

tobymao / sqlglot
Python SQL Parser and Transpiler
transpiler sql python parser optimizer bigquery duckdb hive mysql postgres presto snowflake spark sqlite sqlparser trino tsql clickhouse redshift databricks
Language:Python 5671
ibis-project / ibis
the portable Python dataframe library
bigquery clickhouse dask database datafusion duckdb impala mssql mysql pandas polars postgresql pyarrow pyspark python snowflake sql sqlalchemy sqlite trino
Language:Python 4303
evidence-dev / evidence
Business intelligence as code: build fast, interactive data visualizations in pure SQL and markdown
analytics business-intelligence dashboard data-engineering data-science data-visualization dbt duckdb exploratory-data-analysis finance open-source self-hosted sql statistics svelte tailwindcss webassembly
Language:JavaScript 3430
lancedb / lance
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
machine-learning computer-vision data-format deep-learning python apache-arrow duckdb mlops data-analysis data-analytics data-science dataops data-centric embeddings rust llms
Language:Rust 3331
antonycourtney / tad
A desktop application for viewing and analyzing tabular data
desktop-application pivots tabular-data csv pivot-tables data-science data-analysis database duckdb parquet-viewer
Language:TypeScript 3027
bruin-data / ingestr
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
bigquery copy-database data-ingestion data-integration data-pipeline duckdb ingestion-pipeline mssql postgresql snowflake
Language:Python 2347
pretzelai / pretzelai
Open-source, browser-local data exploration using DuckDB-Wasm and PRQL
analytics artificial-intelligence business-intelligence businessintelligence dashboard data data-analysis data-analytics data-science data-visualization duckdb notebooks open-source prql reporting sql sql-editor sql-editor-online visualization wasm
Language:TypeScript 1462
rill
rilldata / rill
Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.
bi business-analytics csv data data-analysis data-visualization dataviz duckdb gcs golang parquet parquet-tools parquet-viewer s3 sql sql-editor svelte sveltejs sveltekit
Language:Go 1381
moj-analytical-services / splink
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
record-linkage spark em-algorithm deduplication deduplicate-data entity-resolution data-matching fuzzy-matching data-science duckdb uk-gov-data-science
Language:Python 1106
scratchdata / scratchdata
Scratch is a swiss army knife for big data.
bigquery clickhouse data-warehouse duckdb hacktoberfest motherduck olap redshift snowflake
Language:Go 1041
duckdb / dbt-duckdb
dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)
dbt duckdb
Language:Python 744
latitude-dev / latitude
Developer-first embedded analytics
analytics business-intelligence dashboard data data-analysis data-analytics data-app data-engineering data-science data-visualization duckdb embedded-analytics exploratory-data-analysis javascript-framework open-source react self-hosted sql svelte tailwindcss
Language:TypeScript 625
ploomber / jupysql
Better SQL in Jupyter. 📊
jupyter sql duckdb mysql bigquery clickhouse hive postgres presto python redshift snowflake spark-sql sqlite trino tsql data-engineering data-science polars
Language:Python 612
Canner / vulcan-sql
Data API Framework for AI Agents and Data Apps
api-builder data-lake data-warehouse database sql analytics reporting spreadsheet bigquery duckdb postgresql snowflake restful-api typescript clickhouse vulcan-sql vulcansql ksqldb ai ai-agent
Language:TypeScript 597
uwdata / mosaic
An extensible framework for linking databases and interactive views.
data duckdb interaction scalability visualization
Language:JavaScript 584
ekzhang / inline-sql
🪄 Inline SQL in any Python program
dsl duckdb olap python query-language sql
Language:Python 415
incentius-foss / WhatTheDuck
WhatTheDuck is an open-source web application built on DuckDB. It allows users to upload CSV files, store them in tables, and perform SQL queries on the data.
csv duckdb sql
Language:Vue 414
duckdb / duckdb-rs
Ergonomic bindings to duckdb for Rust
duckdb ffi-bindings ffi rust database olap arrow
Language:Rust 372
WrenAI
Canner / WrenAI
WrenAI makes your database RAG-ready. Implement Text-to-SQL more accurately and securely.
bigquery duckdb llm openai postgresql rag text-to-sql ai sql python typescript nlidb agent fastapi nextjs
Language:TypeScript 303
Giorgi / DuckDB.NET
Bindings and ADO.NET Provider for DuckDB
duckdb ado-net data-science duckdb-database hacktoberfest hacktoberfest2023
Language:C# 287
sutoiku / puffin
Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg
arrow duckdb iceberg serverless
283
Mause / duckdb_engine
SQLAlchemy driver for DuckDB
duckdb python sql sqlalchemy duckdb-engine
Language:Python 275
alitrack / duckdb_fdw
DuckDB Foreign Data Wrapper for PostgreSQL
duckdb foreign-data-wrapper postgresql duckdb-fdw fdw
Language:PLpgSQL 247
datonic / datadex
📦 Serverless and local-first Open Data Platform
sql dbt duckdb open-data quarto
Language:Jupyter Notebook 209
duckdblabs / duckplyr
A drop-in replacement for dplyr, powered by DuckDB for performance.
dplyr duckdb analytics dataframe performance r
Language:R 200
duckdb / sqlite_scanner
DuckDB extension to read and write to SQLite databases
sql sqlite duckdb
Language:C 185
nshiab / simple-data-analysis
Easy-to-use and high-performance JavaScript library for data analysis.
data javascript nodejs data-analysis data-science duckdb typescript
Language:TypeScript 184
advanced-alchemy
litestar-org / advanced-alchemy
A carefully crafted, thoroughly tested, optimized companion library for SQLAlchemy
duckdb fastapi litestar mysql oracle-db postgresql sanic spanner sqlalchemy sqlite starlette alembic repository-pattern mssql cockroachdb litestar-org
Language:Python 168
dagster-io / mdsfest-opensource-mds
Demo Project for Open Source MDS
dagster data duckdb mds modern stack
Language:Python 143
BauplanLabs / quack-reduce
A playground for running duckdb as a stateless query engine over a data lake
duckdb lambda serverless sql streamlit-dashboard
Language:Python 134
valmi-activation
valmi-io / valmi-activation
⚡ valmi.io reverse ETL (data activation) is the open source ( OSS ) data activation platform to load data from warehouses into Webhooks and SaaS tools like Klaviyo, Facebook Ads, Salesforce, Braze etc. Valmi.io Customer Data Platform (CDP) helps track and ingest user activity events from websites, shopify, serverside events. https://cloud.valmi.io
cdp reverse-etl dbt airbyte dagster email-marketing marketing-automation push-notifications modern-data-stack duckdb composable-cdp open-source event-ingestion ecommerce shopify shopify-app shopify-events event-tracking user-behavior etl
Language:Python 130
kraina-ai / quackosm
QuackOSM: an open-source Python and CLI tool for reading OpenStreetMap PBF files using DuckDB
duckdb geo geospatial openstreetmap osm pbf python
Language:Python 124
PRQL / prql-query
Query and transform data with PRQL
csv csv-converter csv-files data database datafusion duckdb json json-files parquet parquet-files parquet-tools parquet-viewer postgresql prql query querydsl
Language:Rust 123
wheretrue / biobear
Work with bioinformatic files using Arrow, Polars, and/or DuckDB
bioinformatics biology rust-bio samtools arrow python biopython duckdb polars pyarrow
Language:Rust 123
cnstlungu / portable-data-stack-dagster
A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB, PostgreSQL and Superset
business-intelligence dagster data-engineering data-visualization dbt duckdb python superset
Language:Python 119
l1xnan / duckling
A fast viewer for CSV/Parquet files and databases such as DuckDB, SQLite, PostgreSQL, MySQL, Clickhouse, etc., base on Tauri
clickhouse duckdb mysql parquet postgresql rust sqlite tauri
Language:Rust 115