fattorib

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

alpaca-lora

Instruct-tune LLaMA on consumer hardware

triton

Development repository for the Triton language and compiler

al-folio

A beautiful, simple, clean, and responsive Jekyll theme for academics

flash-attention

Fast and memory-efficient exact attention

algorithmica

A computer science textbook

pythia

The hub for EleutherAI's work on interpretability and learning dynamics

lion-pytorch

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

AlpacaDataCleaned

Alpaca dataset from Stanford, cleaned and curated

codealpaca

basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

maxas

Assembler for NVIDIA Maxwell architecture

TransformerLens

A library for mechanistic interpretability of GPT-style language models

safari

Convolutions for Sequence Modeling

H3

Language Modeling with the H3 State Space Model

examples

Example code and applications for machine learning on Graphcore IPUs

SGEMM_CUDA

Fast CUDA matrix multiplication from scratch

in-context-ralm

minChatGPT

A minimum example of aligning language models with RLHF similar to ChatGPT

unnatural-instructions

myGEMM

Code appendix to an OpenCL matrix-multiplication tutorial

poplibs

Poplar libraries

language-model-agents

Experiments with generating opensource language model assistants

lovely-jax

JAX Arrays for human consumption

tutorials

Training material for IPU users: tutorials, feature examples, simple applications

jax-experimental

JAX for Graphcore IPU (experimental)

ipu-hpc-cookbook

Useful tutorials and recipes for developers doing low-level work with the Graphcore IPU

lm-eval2

ChapterBreak