yuanenming

mamba

Mamba SSM architecture

BERTopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

LLM101n

LLM101n: Let's build a Storyteller

SWE-agent

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.47% of bugs in the SWE-bench evaluation set and takes just 1 minute to run.

evalverse-IFEval

Submodule of evalverse forked from [google-research/instruction_following_eval](https://github.com/google-research/google-research/tree/master/instruction_following_eval)

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

HumanSystemOptimization

健康学习到150岁 - 人体系统调优不完全指南

LWM

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

nanotron

Minimalistic large language model 3D-parallelism training

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

SPIN

The official implementation of Self-Play Fine-Tuning (SPIN)

Megatron-LM

Ongoing research training transformer models at scale

search_with_lepton

Building a quick conversation-based search demo with Lepton AI.

self-rewarding-lm-pytorch

Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI

MOSS-RLHF

MOSS-RLHF

mamba-minimal

Simple, minimal implementation of the Mamba SSM in one file of PyTorch.

NeMo-Aligner

Scalable toolkit for efficient model alignment

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

inshellisense

IDE style command line auto complete

ChatGPT-AutoExpert

🚀🧠💬 Supercharged Custom Instructions for ChatGPT (non-coding) and ChatGPT Advanced Data Analysis (coding).

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Startup-CTO-Handbook

The Startup CTO's Handbook, a book covering leadership, management and technical topics for leaders of software engineering teams

system-design-101

Explain complex systems using visuals and simple terms. Help you prepare for system design interviews.

deep-learning-pytorch-huggingface

alignment-handbook

Robust recipes to align language models with human and AI preferences

ArXivQA

WIP - Automated Question Answering for ArXiv Papers with Large Language Models (https://arxiv.taesiri.xyz/)

multipack_sampler

Multipack distributed sampler for fast padding-free training of LLMs