zhouhai88

annotated_deep_learning_paper_implementations

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

openpilot

openpilot is an open source driver assistance system. openpilot performs the functions of Automated Lane Centering and Adaptive Cruise Control for 250+ supported car makes and models.

LLaMA-Factory

Unify Efficient Fine-Tuning of 100+ LLMs

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

ChatGLM3

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

flash-attention

Fast and memory-efficient exact attention

triton

Development repository for the Triton language and compiler

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.

Megatron-LM

Ongoing research training transformer models at scale

trl

Train transformer language models with reinforcement learning.

CodeGeeX

CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)

Yi

A series of large language models trained from scratch by developers @01-ai

LaWGPT

🎉 Repo for LaWGPT, Chinese-Llama tuned with Chinese Legal knowledge. 基于中文法律知识的大语言模型

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

Firefly

Firefly: 大模型训练工具，支持训练Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

OLMo

Modeling, training, eval, and inference code for OLMo

improved-diffusion

Release for Improved Denoising Diffusion Probabilistic Models

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

lm-human-preferences

Code for the paper Fine-Tuning Language Models from Human Preferences

awesome_LLMs_interview_notes

LLMs interview notes and answers:该仓库主要记录大模型（LLMs）算法工程师相关的面试题和参考答案

makeMoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

nngen

PythonAiRoad

source code of some articles

MINI_LLM

This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.

LongQLoRA

LongQLoRA: Extent Context Length of LLMs Efficiently

lm-human-preference-details

RLHF implementation details of OAI's 2019 codebase

cuda_learning

learning how CUDA works

sa-bot

一个LLMs接口的学习示例