Longzhi Wang's repositories
act
Run your GitHub Actions locally 🚀
AutoGPTQ
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Awesome-LLM-Compression
Awesome LLM compression research papers and tools.
DeepCache
[CVPR 2024] DeepCache: Accelerating Diffusion Models for Free
EAGLE
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
flash-attention
Fast and memory-efficient exact attention
flashinfer
FlashInfer: Kernel Library for LLM Serving
gemma.cpp
lightweight, standalone C++ inference engine for Google's Gemma models.
gemma_pytorch
The official PyTorch implementation of Google's Gemma models
gligen-gui
An intuitive GUI for GLIGEN that uses ComfyUI in the backend
grok-1
Grok open release
InternVL
[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的可商用开源多模态对话模型
KIVI
KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
KVQuant
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
llm-awq
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
OmniQuant
[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
Open-Sora-Plan
This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.
Paddle
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）
PaddleNLP
👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
sglang
SGLang is yet another fast serving framework for large language models and vision language models.
SpeculativeDecodingPapers
📰 Must-read papers and blogs on Speculative Decoding ⚡️
stable-fast
Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
triton
Development repository for the Triton language and compiler
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
xDiT
xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) on multi-GPU Clusters