yh8899

followers

following

stars

yh8899's starred repositories

ao

Native PyTorch library for quantization and sparsity

Language:PythonBSD-3-Clause29900

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

Language:Jupyter NotebookMIT983700

dlrover

DLRover: An Automatic Distributed Deep Learning System

Language:PythonNOASSERTION101000

ThunderKittens

Tile primitives for speedy kernels

Language:CudaMIT118800

cudnn-frontend

cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it

Language:C++MIT33900

examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

Language:PythonBSD-3-Clause2189100

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Language:PythonMIT3273400

llm.c

LLM training in simple, raw C/CUDA

Language:CudaMIT2028400

fms-fsdp

🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

Language:PythonApache-2.09400

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Language:PythonNOASSERTION168300

DeepSpeedExamples

Example models using DeepSpeed

Language:PythonApache-2.0577100

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

Language:PythonApache-2.01065700

SVD_Xtend

Stable Video Diffusion Training Code and Extensions.

Language:Python39800

fastai

The fastai deep learning library

Language:Jupyter NotebookApache-2.02574800

generative-models

Generative Models by Stability AI

Language:PythonMIT2286900

optimum-quanto

A pytorch quantization backend for optimum

Language:PythonApache-2.061400

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

Language:PythonApache-2.01731200

text-generation-inference

Large Language Model Text Generation Inference

Language:PythonApache-2.0816600

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Language:PythonApache-2.02048300

pytorch-original-transformer

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Language:Jupyter NotebookMIT94200

nanotron

Minimalistic large language model 3D-parallelism training

Language:PythonApache-2.088200

ml-engineering

Machine Learning Engineering Open Book

Language:PythonCC-BY-SA-4.01004300

MegCC

MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器

Language:C++Apache-2.046600

torch-mlir

The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.

Language:C++NOASSERTION121400

I-BERT

[ICML'21 Oral] I-BERT: Integer-only BERT Quantization

Language:PythonMIT21200

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

Language:PythonMIT560500

gptq

Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

Language:PythonApache-2.0175500

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Language:PythonMIT395600

onediff

OneDiff: An out-of-the-box acceleration library for diffusion models.

Language:PythonApache-2.0131500

Yuan-2.0

Yuan 2.0 Large Language Model

Language:PythonNOASSERTION66200