EleutherAI

the-pile

vqgan-clip

pyfra

Python Research Framework

openwebtext2

magiCARP

One stop shop for all things carp

mp_nerf

Massively-Parallel Natural Extension of Reference Frame

polyglot-data

data related codebase for polyglot project

exploring-contrastive-topology

text-generation-testing-ui

Web app for demoing the EAI models

NeMo

NeMo: a toolkit for conversational AI

pile-cc

pilev2

architecture-objective

multimodal-fid

CodeCARP

Data collection pipeline for CodeCARP. Includes PyCharm plugins.

GPTeacher

A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer

architecture-experiments

Repository to host architecture experiments and development using Paxml and Praxis

FLAN

composer

Train neural networks up to 7x faster

eai-prompt-gallery

Library of interesting prompt generations

eleutherai-instruct-dataset

A large instruct dataset for open-source models (WIP).

examples

Mosaicml example benchmarks + LLM scripts

groupoid-rl

alignment-reader

Search and filter through alignment literature

BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

maxtext

A simple, performant and scalable Jax LLM!

minetest_game

Minetest Game - The default game for the Minetest engine [https://github.com/minetest/minetest/]

CommonLoopUtils

[WIP] a version of CLU with WandB logging added.

oslo-1

OSLO: Open Source for Large-scale Optimization

t-zero

Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)