Unofish

llama.cpp

LLM inference in C/C++

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

LLaMA-Factory

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

llama3

The official Meta Llama 3 GitHub site

mlc-llm

Universal LLM Deployment Engine with ML Compilation

unsloth

Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

yolov10

YOLOv10: Real-Time End-to-End Object Detection [NeurIPS 2024]

accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

miniforge

A conda-forge distribution.

Firefly

Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

GLM-4

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

xtuner

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

UltraChat

Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)

awesome-model-quantization

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

mmengine

OpenMMLab Foundational Library for Training Deep Learning Models

Awesome-LLM-Compression

Awesome LLM compression research papers and tools.

mlc-MiniCPM

MiniCPM on Android platform.

long-context-attention

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

qmoe

Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".

LLM-QAT

Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"

nntrainer

NNtrainer is Software Framework for Training Neural Network Models on Devices.

ChatGLM_mutli_gpu_tuning

deepspeed+trainer简单高效实现多卡微调大模型

LearnDeepSpeed

DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）

BabyLlama

Training code for Baby-Llama, our submission to the strict-small track of the BabyLM challenge.

private_llm

LLM-inference-optimization-paper

Summary of some awesome work for optimizing LLM inference

profiler-workshop

Example code for profiler workshop

YanshiShield