StellaAthena

transformer-memorization

OpenPrompt

An Open-Source Framework for Prompt-Learning.

starter-hugo-academic

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

mesh-transformer-jax

Model parallel transformers in JAX and Haiku

RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

StellaAthena

GitHub README

trlx

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

city-circuits

client

🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.

DeeperSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

eleuther.ai

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

llama

Inference code for LLaMA models

magma

MAGMA - a GPT-style multimodal model that can understand any combination of images and language

metaseq

Repo for external large-scale work

ML_SageMaker_Studies

Case studies, examples, and exercises for learning to deploy ML models using AWS SageMaker.

moss.rb

A plagiarism detection engine based on Stanford's MOSS(Measure of Software Similarity)

mtg

Collection of data science and machine learning projects for Magic: the Gathering

point-transformer-pytorch

Implementation of the Point Transformer layer, in Pytorch

promptsource

Toolkit for collecting and applying templates of prompting instances

speak-memory

Code and data to support "Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4"

t-zero

Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)

taming-transformers

Taming Transformers for High-Resolution Image Synthesis

TopographicVAE

Official implementation of the paper "Topographic VAEs learn Equivariant Capsules"

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

VQGAN-CLIP

Just playing with getting VQGAN+CLIP running locally, rather than having to use colab.

women-tech-speakers-organizers

A list of women tech speakers & organizers. Add yourself or others by submitting a PR! PS if you do add someone, make sure to tell them! :) #fempire