kylepierce

mermaid

Generation of diagrams like flowcharts or sequence diagrams from text in a similar manner as markdown

localstack

💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline

cli

🥧 HTTPie CLI — modern, user-friendly command-line HTTP client for the API era. JSON support, colors, sessions, downloads, plugins & more.

simdjson

Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

cube

📊 Cube — The Semantic Layer for Building Data Applications

prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

data-engineer-roadmap

Roadmap to becoming a data engineer in 2021

dagster

An orchestration platform for the development, production, and observation of data assets.

trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

gridstudio

Grid studio is a web-based application for data science with full integration of open source data science frameworks and languages.

mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

papermill

📚 Parameterize, execute, and analyze notebooks

google-cloud-python

Google Cloud Client Library for Python

amundsen

Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.

llm-app

Dynamic RAG for enterprise. Ready to run with Docker,⚡in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

texthero

Text preprocessing, representation and visualization from zero to hero.

dbml

Database Markup Language (DBML), designed to define and document database structures

nyt-2020-election-scraper

DataProfiler

What's in your data? Extract schema, statistics and entities from datasets

pydash

The kitchen sink of Python utility libraries for doing "stuff" in a functional way. Based on the Lo-Dash Javascript library.

streamz

Real-time stream processing for python

name-dataset

The Python library for names.

sql-metadata

Uses tokenized query returned by python-sqlparse and generates query metadata

pdpipe

Easy pipelines for pandas DataFrames.

AttackVectors

A repository to monitor attack vectors from state-backed information operations

dbt-ga4

dbt Package for modeling raw data exported by Google Analytics 4. BigQuery support, only.

prefect-orion

droughty

Droughty helps keep your workflow dry