EleutherAI

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

lm-evaluation-harness

A framework for few-shot evaluation of language models.

pythia

The hub for EleutherAI's work on interpretability and learning dynamics

the-pile

math-lm

polyglot

Polyglot: Large Language Models of Well-balanced Competence in Multi-languages

concept-erasure

Erasing concepts from neural representations with provable guarantees

elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.

oslo

OSLO: Open Source for Large-scale Optimization

DeeperSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

dps

Data processing system for polyglot

improved-t5

Experiments for efforts to train a new and improved t5

minetest

Minetest is an open source voxel game engine with easy modding and game creation

semantic-memorization

hae-rae

polyglot-data

data related codebase for polyglot project

music-transformer

NeMo

NeMo: a toolkit for conversational AI

pile_dedupe

Pile Deduplication Code

lm-eval2

tagged-pile

Part-of-Speech Tagging for the Pile and RedPajama

GPTeacher

A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer

minetest-baselines

Baseline agents for Minetest tasks.

architecture-experiments

Repository to host architecture experiments and development using Paxml and Praxis

LLM-Markov-Chains

Project github for LLM Markov Chains Project

Unpaired-Image-Generation

Project Repo for Unpaired Image Generation project

website

New website for EleutherAI based on Hugo static site generator

eleutherai-instruct-dataset

A large instruct dataset for open-source models (WIP).

maxtext

A simple, performant and scalable Jax LLM!

oslo-1

OSLO: Open Source for Large-scale Optimization