yuanenming

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

system-design-101

Explain complex systems using visuals and simple terms. Help you prepare for system design interviews.

HumanSystemOptimization

健康学习到150岁 - 人体系统调优不完全指南

SWE-agent

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.47% of bugs in the SWE-bench evaluation set and takes just 1 minute to run.

Startup-CTO-Handbook

The Startup CTO's Handbook, a book covering leadership, management and technical topics for leaders of software engineering teams

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

Megatron-LM

Ongoing research training transformer models at scale

minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

inshellisense

IDE style command line auto complete

search_with_lepton

Building a quick conversation-based search demo with Lepton AI.

LWM

ChatGPT-AutoExpert

🚀🧠💬 Supercharged Custom Instructions for ChatGPT (non-coding) and ChatGPT Advanced Data Analysis (coding).

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

alignment-handbook

Robust recipes to align language models with human and AI preferences

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

mamba-minimal

Simple, minimal implementation of the Mamba SSM in one file of PyTorch.

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

self-rewarding-lm-pytorch

Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI

MOSS-RLHF

MOSS-RLHF

nanotron

Minimalistic large language model 3D-parallelism training

SPIN

The official implementation of Self-Play Fine-Tuning (SPIN)

fine-tune-mistral

Fine-tune mistral-7B on 3090s, a100s, h100s

deep-learning-pytorch-huggingface

tokenmonster

Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript

textbook_quality

Generate textbook-quality synthetic LLM pretraining data

NeMo-Aligner

Scalable toolkit for efficient model alignment

ArXivQA

WIP - Automated Question Answering for ArXiv Papers with Large Language Models (https://arxiv.taesiri.xyz/)

multipack_sampler

Multipack distributed sampler for fast padding-free training of LLMs

evalverse-IFEval

Submodule of evalverse forked from [google-research/instruction_following_eval](https://github.com/google-research/google-research/tree/master/instruction_following_eval)