westonpace

arrow-cdata-example

A minimal pybind11 arrow-c++ module using the C data interface

substrait-expr

A utility library for working with Substrait expressions (and maybe someday plans), still a WIP

crossbow

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

quiver

arrow

Apache Arrow is a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware. It also provides computational libraries and zero-copy streaming messaging and interprocess communication. Languages currently supported include C, C++, Java, JavaScript, Python, and Ruby.

arrow-benchmarks-ci

Benchmarks CI for Apache Arrow project

arrow-datafusion

Apache Arrow DataFusion SQL Query Engine

arrow-datafusion-python

Apache Arrow DataFusion Python Bindings

arrow-experiments

Various experiments and tests written to better understand apache/arrow

arrow-ipc-bench

Testing various methods of moving Arrow data between processes

arrow-rs

Official Rust implementation of Apache Arrow

arrow-site

Mirror of Apache Arrow site

benchmarks

Language-independent Continuous Benchmarking (CB) for Apache Arrow

hyper-test

ioprof

Quick I/O testing app

joey

baby quokka

lance-experiments

lancedb

Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!

object_store_bench

Just some random benchmarking scripts for playing with cloud storage

objs

rust-git-version

Compile the Git version (tag name, or hash otherwise) and dirty state into your Rust program.

s3bench

substrait

A cross platform way to express data transformation, relational algebra, standardized record expression and plans.

substrait-fiddle

An online tool to share, debug, and prototype substrait queries

substrait-js

substrait-js-test

substrait-rs

Rust crate for Substrait: Cross-Language Serialization for Relational Algebra

substrait-test-fork

vercel_blob

Rust client for the vercel blob API