miguel-kjh

yt-dlp

A feature-rich command-line audio/video downloader

grok-1

Grok open release

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

ml-agents

The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.

mamba

Mamba SSM architecture

minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

storm

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

cleanrl

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

alignment-handbook

Robust recipes to align language models with human and AI preferences

mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

RL4LMs

A modular RL library to fine-tune language models to human preferences

AgentBench

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

TransformerLens

A library for mechanistic interpretability of GPT-style language models

awesome-llm-interpretability

A curated list of Large Language Model (LLM) Interpretability resources.

MergeLM

Codebase for Merging Language Models (ICML 2024)

TinderBotz

Automated Tinder bot and scraper using selenium in python.

vstar

PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"

LLM-workshop-2024

A 4-hour coding workshop to understand how LLMs are implemented and used

awesome-llm-human-preference-datasets

A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.

ARENA_3.0

dora-from-scratch

LoRA and DoRA from Scratch Implementations

CircuitsVis

Mechanistic Interpretability Visualizations using React

sparse_coding

Using sparse coding to find distributed representations used by neural networks.

CKA-similarity

An Numpy and PyTorch Implementation of CKA-similarity with CUDA support

rust_circuit_public

goodai-ltm-benchmark

A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you need to evaluate your own agents. See more in the blogpost:

HMTNet

Official PyTorch implementation of paper <Hierarchical Multi-task Network For Race, Gender and Facial Attractiveness Recognition> (IEEE International Conference on Image Processing (ICIP) 2019)

gpt2-greater-than

Code Release for the 2023 NeurIPS Paper How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model

nn_pruning_uniqueness

Prune a model while finetuning or training.