alphaRGB

transformers-benchmarks

real Transformer TeraFLOPS on various GPUs

paper-reading

深度学习经典、新论文逐段精读

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

micrograd

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

trlx

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

Awesome-Pruning

A curated list of neural network pruning resources.

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

OpenWrt-Rpi

Raspberry Pi & NanoPi R2S/R4S & G-Dock & x86 OpenWrt Compile Project. (Based on Github Action / Daily Update)

trojan

An unidentifiable mechanism that helps you bypass GFW.

website

快柠檬最新官网。

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

CS-Notes

:books: 技术面试必备基础知识、Leetcode、计算机操作系统、计算机网络、系统设计

sparsegpt

Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".

ccf-deadlines

⏰ Collaboratively track deadlines of conferences recommended by CCF (Website, Python Cli, Wechat Applet) / If you find it useful, please star this project, thanks~

simple-mpt30b-ddp

Simple Example to train MPT 30B (Single GPU and DDP) model using LORA and Int8 training

LLMsPracticalGuide

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

torchquantum

A PyTorch-based framework for Quantum Classical Simulation, Quantum Machine Learning, Quantum Neural Networks, Parameterized Quantum Circuits with support for easy deployments on real quantum computers.

Train_Transformers_with_INT4

lsq-net

Unofficial implementation of LSQ-Net, a neural network quantization framework

cutlass

CUDA Templates for Linear Algebra Subroutines

FP8-quantization

activitywatch

The best free and open-source automated time tracker. Cross-platform, extensible, privacy-focused.

FP8-Emulation-Toolkit

PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.

ppq

PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.

smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models