EleutherAI

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

polyglot

Polyglot: Large Language Models of Well-balanced Competence in Multi-languages

pythia

pyfra

Python Research Framework

oslo

OSLO: Open Source for Large-scale Optimization

DeeperSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

magiCARP

One stop shop for all things carp

openwebtext2

github-downloader

Script for downloading GitHub.

mp_nerf

Massively-Parallel Natural Extension of Reference Frame

dps

Data processing system for polyglot

exploring-contrastive-topology

polyglot-data

data related codebase for polyglot project

website

New website for EleutherAI based on Hugo static site generator

text-generation-testing-ui

Web app for demoing the EAI models

NeMo

NeMo: a toolkit for conversational AI

architecture-objective

minetest

Minetest is an open source voxel game engine with easy modding and game creation

pilev2

FLAN

lm_dataformat

multimodal-fid

alignment-reader

Search and filter through alignment literature

BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

composer

Train neural networks up to 7x faster

irrlicht

Minetest's fork of Irrlicht

mosaicml-examples

Mosaicml example benchmarks + LLM scripts

CommonLoopUtils

[WIP] a version of CLU with WandB logging added.

minetest_game

Minetest Game - The default game for the Minetest engine [https://github.com/minetest/minetest/]