MrPowers

quinn

pyspark methods to enhance developer productivity 📣 👯 🎉

chispa

PySpark test helper methods with beautiful error messages

spark-fast-tests

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)

mack

Delta Lake helper methods in PySpark

spark-style-guide

Spark style guide

jodie

Delta lake and filesystem helper methods

farsante

Fake Pandas / PySpark DataFrame creator

ceja

PySpark phonetic and string matching algorithms

levi

Delta Lake helper methods. No Spark dependency.

python-parquet-examples

Using the Parquet file format with Python

eren

PySpark Hive helper methods

deltadask

Delta Lake powered by Dask

mrpowers-benchmarks

MrPowers benchmarks for Dask, Polars, DataFusion, and pandas

datafusion-book

DataFusion book

mesita

Print colorful tables with nice diffs in the Terminal

data-scrapbook

A collection of images and captions to explain core data concepts

delta-rs

A native Rust library for Delta Lake, with bindings into Python

mrpowers-book

Book on MrPowers OSS projects, blogs, and other assets

mrpowers.github.io

Documentation and stuff

pydata-examples

Examples of various PyData technologies like pandas, DataFusion, DuckDB, and Polars

pyspark-examples

PySpark example notebooks

sparkprof

Pretty Spark docs

arrow-datafusion

Apache Arrow DataFusion SQL Query Engine

arrow-datafusion-python

Apache Arrow DataFusion Python Bindings

db-benchmark

reproducible benchmark of database-like ops

deltaray

Delta reader for the Ray open-source toolkit for building ML applications

deltatorch

lance-examples

Examples with Lance table format

spark

Mirror of Apache Spark

spark-website

Apache Spark Website