lcc0504

alpaca-lora

Instruct-tune LLaMA on consumer hardware

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ

neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

gptq

Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

awesome-model-quantization

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

DiffuSeq

[ICLR'23] DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models

OmniQuant

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

SpQR

MS-AMP

Microsoft Automatic Mixed Precision Library

QuIP

Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"

MambaIR

A simple baseline for image restoration with state-space model.

q-diffusion

[ICCV 2023] Q-Diffusion: Quantizing Diffusion Models.

Atom

[MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

BlackMamba

Code repository for Black Mamba

language-model-arithmetic

Controlled Text Generation via Language Model Arithmetic

RPTQ4LLM

Reorder-based post-training quantization for large language model

LLM-FP4

The official implementation of the EMNLP 2023 paper LLM-FP4

Train_Transformers_with_INT4

PTQ4DM

Implementation of Post-training Quantization on Diffusion Models (CVPR 2023)

PTQD

The official implementation of PTQD: Accurate Post-Training Quantization for Diffusion Models

disentangle-semantics-syntax

Code for "A Multi-Task Approach for Disentangling Syntax and Semantics in Sentence Representations" (NAACL 2019)

Awesome-Mamba-in-Low-Level-Vision

A paper list of recent mamba efforts for low-level vision.

QuantSR

[NeurIPS 2023 Spotlight] This project is the official implementation of our accepted NeurIPS 2023 (spotlight) paper QuantSR: Accurate Low-bit Quantization for Efficient Image Super-Resolution.

DDTB

Pytorch implementation of our paper accepted by ECCV2022 -- Dynamic Dual Trainable Bounds for Ultra-low Precision Super-Resolution Networks

Discriminator-Cooperative-Unlikelihood-Prompt-Tuning

The code implementation of the EMNLP2022 paper: DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Generation

DiffuSeq_StylePTB

Residual_Memory_Transformer

This repository contains code, data, checkpoints, and training and evaluation instructions for the paper: Controllable Text Generation with Residual Memory Transformer