da115115

system-design-primer

Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

cube

📊 Cube — The Semantic Layer for Building Data Applications

oss-fuzz

OSS-Fuzz - continuous fuzzing for open source software.

cloudquery

The open source high performance ELT framework powered by Apache Arrow

wing

A programming language for the cloud ☁️ A unified programming model, combining infrastructure and runtime code into one language ⚡

plot

A concise API for exploratory data visualization implementing a layered grammar of graphics

aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

libarchive

Multi-format archive and compression library

framework

A static site generator for data apps, dashboards, reports, and more. Observable Framework combines JavaScript on the front-end for interactive graphics with any language on the back-end for data analysis.

incubator-livy

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

chronon

Chronon is a data platform for serving for AI/ML applications.

data-on-eks

DoEKS is a tool to build, deploy and scale Data & ML Platforms on Amazon EKS

SOMA-B2B-SaaS

openhouse

Open Control Plane for Tables in Data Lakehouse

action-validator

Tool to validate GitHub Action and Workflow YAML files

dbt_metrics

Macros for calculating metrics

lea

🏃‍♀️ Minimalist alternative to dbt

djl-serving

A universal scalable machine learning model deployment solution

yato

The smallest DuckDB SQL orchestrator on Earth.

hashquery

A Python framework for defining and querying BI models in your data warehouse

pypi-duck-flow

end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence

inputs

Better input elements

add-determinism

Build postprocessor to reset metadata fields for build reproducibility

duckdb_aws

pace

Data policy IN, dynamic view OUT: PACE is the Policy As Code Engine. It helps you to programatically create and apply a data policy to a processing platform like Databricks, Snowflake or BigQuery (or plain 'ol Postgres, even!) with definitions imported from Collibra, Datahub, ODD and the like.

volga

Feature Engine for real-time AI/ML

pymetastore

A Python Client for Hive Metastore

databricks-dataproduct-example

all_purpose_bypass