EleutherAI

polyglot

Polyglot: Large Language Models of Well-balanced Competence in Multi-languages

oslo

OSLO: Open Source for Large-scale Optimization

dps

Data processing system for polyglot

github-downloader

Script for downloading GitHub.

stackexchange-dataset

Python tools for processing the stackexchange data dumps into a text dataset for Language Models

hae-rae

best-download

URL downloader supporting checkpointing and continuous checksumming.

mdl

Minimum Description Length probing for neural network representations

pile_dedupe

Pile Deduplication Code

lm_dataformat

tagged-pile

Part-of-Speech Tagging for the Pile and RedPajama

trlx

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

LLM-Markov-Chains

Project github for LLM Markov Chains Project

minetest-baselines

Baseline agents for Minetest tasks.

llemma-sample-explorer

Sample explorer tool for the Llemma models.

minetest-interpretabilty-notebook

Jupyter notebook for the interpretablity section of the minetester blog post

Unpaired-Image-Generation

Project Repo for Unpaired Image Generation project

latent-video-diffusion

Latent video diffusion

pile-website

EvilModel

A replication of "EvilModel 2.0: Bringing Neural Network Models into Malware Attacks"

irrlicht

Minetest's fork of Irrlicht

language-adaptation

tinydpo

classifier-latent-diffusion

common-llm-settings

Common LLM Settings App

prefix-free-tokenizer

A prefix free tokenizer

truncated-gaussian

Method-of-moments estimation and sampling for truncated multivariate Gaussian distributions

gaia

Hugging Face and Pyserini interoperability

mup

maximal update parametrization (µP)

Plenoxels_FreeNerf

implmentation of Plenoxels radiance fields without neural networks, with free nerf strategy