stanford-crfm

helm

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in Holistic Evaluation of Text-to-Image Models (HEIM) (https://arxiv.org/abs/2311.04287).

BioMedLM

mistral

Mistral: A strong, northwesterly wind: Framework for transparent and accessible large-scale language model training, built with Hugging Face 🤗 Transformers.

levanter

Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax

ecosystem-graphs

haliax

Named Tensors for Legible Deep Learning in JAX

EUAIActJune15

Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act

fmti

The Foundation Model Transparency Index

halie

helm-efficiency

transformers

🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

data-overlap

sprucfluo

Data streaming for LMs. WIP

janus

A Streamlit interface that's a doorway into GPT-X.

composer

Composing methods for ML training efficiency

transformers_fsdp_checkpoint_fix

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

mosaicml-benchmarks

Fast and flexible reference benchmarks