martindurant

fastparquet

python implementation of the parquet columnar file format.

gcsfs

Pythonic file-system interface for Google Cloud Storage

intake

A plugin system for loading your data and making data catalogs.

dask

Versatile parallel programming with task scheduling

fastfeather

Feather to pandas loader without pyarrow

filesystem_spec

A specification that python filesystems should adhere to.

fsspec-reference-maker

Functions to make reference descriptions for ReferenceFileSystem

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

s3fs

S3 Filesystem

akimbo

Awkward Array Pandas Extension

an_intake_project

awkward

Development of awkward 1.0, to replace scikit-hep/awkward-array in 2020.

dask-awkward

Connecting Dask with Awkward Arrays

dplib-py

Python implementation of the Data Package standard and various models and utils for working with data

intake-erddap

Intake interface to ERDDAP

intake-examples

Intake examples

intake-feedstock

A conda-smithy repository for intake.

intake-parquet

Parquet plugin for Intake

intake-public-datasets

Intake catalogs pointing to freely available data

intake-sql

Plugin for Intake to read from SQL servers

intake-thredds

Siphon to Intake translation layer

intake-xarray

Intake plugin for xarray

kerchunk-feedstock

A conda-smithy repository for kerchunk.

martindurant.github.io

web pages

numcodecs

A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.

python-snappy

Python bindings for the snappy google library

uproot5

ROOT I/O in pure Python and NumPy.

xarray

N-D labeled arrays and datasets in Python

zarr

A minimal implementation of chunked, compressed, N-dimensional arrays for Python.

zarrita