post-training-quantization

There are 4 repositories under post-training-quantization topic.

666DZY666 / micronet
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
quantization pruning dorefa twn bnn xnor-net pytorch model-compression group-convolution network-slimming neuromorphic-computing convolutional-networks network-in-network integer-arithmetic-only quantization-aware-training post-training-quantization tensorrt onnx tensorrt-int8-python batch-normalization-fuse
Language:Python 2177
intel / neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
auto-tuning awq fp4 gptq int4 int8 knowledge-distillation large-language-models low-precision mxformat post-training-quantization pruning quantization quantization-aware-training smoothquant sparsegpt sparsity
Language:Python 1951
alibaba / TinyNeuralNetwork
TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.
deep-learning deep-neural-networks model-compression model-converter post-training-quantization pruning pytorch quantization-aware-training
Language:Python 703
SqueezeAILab / SqueezeLLM
SqueezeLLM: Dense-and-Sparse Quantization
efficient-inference large-language-models llm model-compression natural-language-processing post-training-quantization quantization text-generation transformer llama localllm small-models
Language:Python 561
megvii-research / Sparsebit
A model compression and acceleration toolbox based on pytorch.
deep-learning post-training-quantization pruning quantization quantization-aware-training sparse tensorrt
Language:Python 319
megvii-research / FQ-ViT
[IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer
imagenet post-training-quantization pytorch quantization vision-transformer
Language:Python 273
Xiuyu-Li / q-diffusion
[ICCV 2023] Q-Diffusion: Quantizing Diffusion Models.
ddim diffusion-models model-compression post-training-quantization pytorch quantization stable-diffusion
Language:Python 263
sayakpaul / Adventures-in-TensorFlow-Lite
This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.
tensorflow-2 tensorflow-lite on-device-ml model-quantization post-training-quantization quantization-aware-training pruning model-optimization tf-lite-model inference tf-hub
Language:Jupyter Notebook 167
Sanjana7395 / static_quantization
Post-training static quantization using ResNet18 architecture
quantization post-training-quantization resnet-18 mnist-classification pytorch floatfunctional fbgemm float32-to-int8 reduce-inference-time reduce-memory-storage
Language:Jupyter Notebook 36
hkproj / quantization-notes
Notes on quantization in neural networks
deep-learning neural-networks post-training-quantization pytorch quantization quantization-aware-training
Language:Jupyter Notebook 25
ModelTC / QLLM
[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"
llama llama2 llm post-training-quantization pytorch quantization transformers
Language:Python 20
ModelTC / TFMQ-DM
[CVPR 2024 Highlight] TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models
ddim diffusion-models ldm post-training-quantization stable-diffusion cvpr cvpr2024 quantization highlight
Language:Jupyter Notebook 15
zysxmu / FDDA
Pytorch implementation of our paper accepted by ECCV 2022-- Fine-grained Data Distribution Alignment for Post-Training Quantization
post-training-quantization acceleration compression
Language:Python 15
KwangHoonAn / Quantizations
dfq data-free-quantization quantization post-training-quantization
Language:Python 13
iszry / DI2N-PTQ4DM
Improved the performance of 8-bit PTQ4DM expecially on FID.
diffusion-model post-training-quantization
Language:Python 8
likholat / openvino_quantization
This sample shows how to convert TensorFlow model to OpenVINO IR model and how to quantize OpenVINO model.
tensorflow openvino quantization model-conversion model-optimizer model-acceleration post-training-quantization
Language:Python 5
Rumeysakeskin / ASR-Quantization
Post-training quantization on Nvidia Nemo ASR model
model-deployment nvidia-nemo post-training-quantization pytorch pytorch-lightning quantization speech-recognition
Language:Jupyter Notebook 4
ssi-research / eptq
Implementation of EPTQ - an Enhanced Post-Training Quantization algorithm for DNN compression
computer-vision hessian neural-network post-training-quantization quantization label-free
Language:Python 4
yester31 / Quantization_EX
quantization example for pqt & qat
qat quantization-aware-training quantization tensorrt post-training-quantization ptq int8 model-optimization pytorch-quantization
Language:Python 4
yester31 / TensorRT_ONNX
Generating tensorrt model using onnx
int8-inference int8-quantization onnx onnxruntime post-training-quantization ptq pytorch quantization tensorrt tensorrt-inference
Language:C++ 3
generalMG / Medical-Dataset-Deep-Learning-Quantization-Data-Analysis
The repository discusses a research work published on MDPI Sensors and provides details about the project.
classification data-analysis data-visualization edge-device image-processing medical-image-processing point-of-care post-training-quantization
Language:Python 2
satya15july / quantization
Model Quantization with Pytorch, Tensorflow & Larq
quantization binarization quantization-aware-training binarymodel-with-larq post-training-quantization
Language:C++ 2
AndreiZoltan / ptq_resnet20
Low-bit (2/4/8/16) Post Training Quantization for ResNet20
computer-vision post-training-quantization pytorch resnet quantization resnet-18
Language:Python 1
TanyaChutani / Quantization_Tensorflow
Quantization for Object Detection in Tensorflow 2.x
quantization quantization-aware-training object-detection tensorflow2 model-optimization post-training-quantization
Language:Python 1
yashmaniya0 / Quantization-of-Image-Classification-Models
Comprehensive study on the quantization of various CNN models, employing techniques such as Post-Training Quantization and Quantization Aware Training (QAT).
post-training-quantization quantization-aware-training
Language:Jupyter Notebook 1
andrea-zanette / HippoScan
A framework to train a ResUNet architecture, quantize, compile and execute it on an FPGA.
alveo fpga pynq segmentation ultra96v2 vitis-ai keras post-training-quantization tensorflow2 resunet
Language:Jupyter Notebook 0
OmidGhadami95 / EfficientNetV2_Quantization_CK
EfficientNetV2 (Efficientnetv2-b2) and quantization int8 and fp32 (QAT and PTQ) on CK+ dataset . fine-tuning, augmentation, solving imbalanced dataset, etc.
efficientnet post-training-quantization ptq qat quantization quantization-aware-training efficientnetv2 ckplus efficientnetv2-b2 emotion-recognition facial-emotion-recognition imbalanced-dataset real-time-emotion-classification real-time-emotion-detection scale-down googlecolab keras python tensorflow
Language:Jupyter Notebook 0
smpanaro / norm-tweaking
Post post-training-quantization (PTQ) method for improving LLMs. Unofficial implementation of https://arxiv.org/abs/2309.02784
llms post-training-quantization quantization ptq
Language:Python 0
raj2022 / quantization_prunings
Post-Training quantization perfomed on the model trained with CLIC dataset.
int8-quantization post-training-quantization
Language:Jupyter Notebook

post-training-quantization

666DZY666 / micronet

intel / neural-compressor

alibaba / TinyNeuralNetwork

SqueezeAILab / SqueezeLLM

megvii-research / Sparsebit

megvii-research / FQ-ViT

Xiuyu-Li / q-diffusion

sayakpaul / Adventures-in-TensorFlow-Lite

Sanjana7395 / static_quantization

hkproj / quantization-notes

ModelTC / QLLM

ModelTC / TFMQ-DM

zysxmu / FDDA

KwangHoonAn / Quantizations

iszry / DI2N-PTQ4DM

likholat / openvino_quantization

Rumeysakeskin / ASR-Quantization

ssi-research / eptq

yester31 / Quantization_EX

yester31 / TensorRT_ONNX

generalMG / Medical-Dataset-Deep-Learning-Quantization-Data-Analysis

satya15july / quantization

AndreiZoltan / ptq_resnet20

TanyaChutani / Quantization_Tensorflow

yashmaniya0 / Quantization-of-Image-Classification-Models

andrea-zanette / HippoScan

OmidGhadami95 / EfficientNetV2_Quantization_CK

smpanaro / norm-tweaking

raj2022 / quantization_prunings