DanielHesslow

flash-attention

Fast and memory-efficient exact attention

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

hh-rlhf

Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"

perftest

GPU texture/buffer performance tester

sidechainnet

An all-atom protein structure dataset for machine learning.

x86-sat

Basic SAT model of x86 instructions using Z3, autogenerated from Intel docs

SEAL

Search Engines with Autoregressive Language models

mnist1d

A 1D analogue of the MNIST dataset for measuring spatial biases and answering Science of Deep Learning questions.

mlir-hello

MLIR Sample dialect

lightonml

Python library for running large-scale computations on LightOn's OPUs

lairgpt

Inference code in Pytorch for GPT-like models, such as PAGnol, a family of models with up to 1.5B parameters, trained on datasets in French.

mlir-graphblas

MLIR tools and dialect for GraphBLAS

lightonmuse

Python client for the LightOn Muse API

zoo