quantization-aware-training

There are 5 repositories under quantization-aware-training topic.

666DZY666 / micronet
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
quantization pruning dorefa twn bnn xnor-net pytorch model-compression group-convolution network-slimming neuromorphic-computing convolutional-networks network-in-network integer-arithmetic-only quantization-aware-training post-training-quantization tensorrt onnx tensorrt-int8-python batch-normalization-fuse
Language:Python 2183
intel / neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
low-precision pruning sparsity auto-tuning knowledge-distillation quantization quantization-aware-training post-training-quantization smoothquant large-language-models awq fp4 gptq int4 int8 mxformat sparsegpt
Language:Python 1994
openvinotoolkit / nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
quantization pruning sparsity quantization-aware-training mixed-precision-training compression semantic-segmentation object-detection classification nlp bert mmdetection transformers hawq pytorch tensorflow onnx openvino deep-learning
Language:Python 830
alibaba / TinyNeuralNetwork
TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.
deep-learning deep-neural-networks model-compression model-converter post-training-quantization pruning pytorch quantization-aware-training
Language:Python 710
SpursLipu / YOLOv3v4-ModelCompression-MultidatasetTraining-Multibackbone
YOLO ModelCompression MultidatasetTraining
mobilenetv3 modelcompression multidataset object-detection pruning quantization-aware-training yolo
Language:Python 443
megvii-research / Sparsebit
A model compression and acceleration toolbox based on pytorch.
deep-learning post-training-quantization pruning quantization quantization-aware-training sparse tensorrt
Language:Python 320
hls4ml-tutorial
fastmachinelearning / hls4ml-tutorial
Tutorial notebooks for hls4ml
fpga hls4ml machine-learning pruning quantization-aware-training tutorial
Language:Jupyter Notebook 257
Beomi / BitNet-Transformers
0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture
llm quantization quantization-aware-training transformers
Language:Python 237
THU-MIG / torch-model-compression
针对pytorch模型的自动化模型结构分析和修改工具集，包含自动分析模型结构的模型压缩算法库
acnet model-compression onnx pruning pytorch qat quantization quantization-aware-training reparameterization tensorrt tensorrt-conversion
Language:Python 193
sayakpaul / Adventures-in-TensorFlow-Lite
This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.
tensorflow-2 tensorflow-lite on-device-ml model-quantization post-training-quantization quantization-aware-training pruning model-optimization tf-lite-model inference tf-hub
Language:Jupyter Notebook 168
clovaai / frostnet
FrostNet: Towards Quantization-Aware Network Architecture Search
deep-learning pytorch quantization quantization-aware-training classification object-detection semantic-segmentation style-transfer optimizers computer-vision post-quantization quantization-efficient-network network-architecture int8-quantization
Language:Python 106
openvinotoolkit / mmdetection
OpenVINO Training Extensions Object Detection
pytorch openvino onnx onnxruntime computer-vision deep-learning object-detection instance-segmentation ssd fcos atss retinanet faster-rcnn mask-rcnn cascade-rcnn nncf compression quantization-aware-training sparsity
Language:Python 93
jahongir7174 / YOLOv8-qat
Quantization Aware Training
int8-inference int8-quantization object-detection python pytorch quantization-aware-training yolov8
Language:Python 41
mlzxy / qsparse
Train neural networks with joint quantization and pruning on both weights and activations using any pytorch modules
model-compression neural-network pruning pytorch quantization-aware-training
Language:Python 39
yashbhalgat / QualcommAI-MicroNet-submission-MixNet
3rd place solution for NeurIPS 2019 MicroNet challenge
competition neurips-2019 micronet-challenge mixnet quantization quantization-aware-training model-pruning unstructured-pruning model-compression
Language:Python 35
jeshraghian / QSNNs
Quantization-aware training with spiking neural networks
spiking neural networks snn backpropagation quantization quantization-aware-training deep-learning spiking-neural-networks neuroscience
Language:Python 32
DeadAt0m / LSQFakeQuantize-PyTorch
FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch
lsq learned-step-size pytorch quantization quantization-aware-training qat torchlsq fakequantize
Language:C++ 31
hkproj / quantization-notes
Notes on quantization in neural networks
deep-learning neural-networks post-training-quantization pytorch quantization quantization-aware-training
Language:Jupyter Notebook 30
bharathsudharsan / CNN_on_MCU
Code for paper 'Multi-Component Optimization and Efficient Deployment of Neural-Networks on Resource-Constrained IoT Hardware'
optimization quantization-aware-training quantization graph-optimization tflite tflite-conversion tinyml cmsis-nn efficient-inference edge-computing neuralnetworks c-code-generator
Language:Jupyter Notebook 24
HaoranREN / TensorFlow_Model_Quantization
A tutorial of model quantization using TensorFlow
model-quantization tensorflow tensorflow-lite inference-efficiency tflite machine-learning quantization-aware-training
Language:Python 12
Intelligent-Microsystems-Lab / SNNQuantPrune
Code for the ISCAS23 paper "The Hardware Impact of Quantization and Pruning for Weights in Spiking Neural Networks"
deep-learning machine-learning quantization quantization-aware-training snn sparsity spiking-neural-networks
Language:Python 9
rishivar / Resnet-18
Image classification done with Mindspore technology
mindspore cifar-10 resnet18 quantization-aware-training
Language:Python 8
HanByulKim / BASQ
BASQ: Branch-wise Activation-clipping Search Quantization for Sub-4-bit Neural Networks, ECCV 2022
eccv2022 neural-architecture-search pytorch quantization quantization-aware-training
Language:Python 7
gulabpatel / Knowledge_Distillation
keras-neural-networks teacher-student-learning tf-quantization quantization quantization-aware-training tflite
Language:Jupyter Notebook 5
LorenzoValente3 / Autoencoder-for-FPGA
Autoencoder model for FPGA implementation using hls4ml. Repository for Applied Electronics Project.
fpga deep-learning hls4ml autoencoder-classification autoencoder-mnist compression quantization-aware-training
Language:Jupyter Notebook 4
SangbumChoi / PyTorch_Quantization
all methods of pytorch quantization based on resnet50
pytorch-lightning quantization-aware-training pytorch-implementation cifar-10 resnet-50
Language:Python 4
yashbhalgat / QualcommAI-MicroNet-submission-EfficientNet
Submission name: QualcommAI-EfficientNet. MicroNet Challenge (NeurIPS 2019) submission - Qualcomm AI Research
competition neurips-2019 micronet-challenge efficientnet mixnet pytorch quantization quantization-aware-training model-pruning model-compression unstructured-pruning
Language:Python 4
yester31 / Quantization_EX
quantization example for pqt & qat
qat quantization-aware-training quantization tensorrt post-training-quantization ptq int8 model-optimization pytorch-quantization
Language:Python 4
etetteh / OoD_Gen-Chest_Xray
Multi-Domain Balanced Sampling Improves Out-of-Distribution Generalization of Chest X-ray Pathology Prediction Models
chest-xray-images chestx-ray8 medical-image-analysis medical-imaging mimic-cxr neurips-2021 nih-chest-x-ray padchest-dataset pathological-images quantization-aware-training torchxrayvision balanced-sampling computer-vision multilabel-classification out-of-distribution-generalization
Language:Python 3
LorenzoValente3 / JointVAE4AD
Disentangle joint continous and discrete representations for Anomaly Detection in High Energy Physics.
anomaly-detection joint-vae quantization-aware-training vae
Language:Jupyter Notebook 3
marekninja / master-thesis
One Bit at a Time: Impact of Quantisation on Neural Machine Translation
encoder-decoder nmt pytorch quantization quantization-aware-training seq2seq transformers transformer fully-quantized-transformer
Language:Jupyter Notebook 3
satya15july / quantization
Model Quantization with Pytorch, Tensorflow & Larq
binarization binarymodel-with-larq post-training-quantization quantization quantization-aware-training
Language:C++ 2
yashmaniya0 / Quantization-of-Image-Classification-Models
Comprehensive study on the quantization of various CNN models, employing techniques such as Post-Training Quantization and Quantization Aware Training (QAT).
post-training-quantization quantization-aware-training
Language:Jupyter Notebook 2
lix19937 / pytorch-quantization
QAT
quantization-aware-training
Language:Python 1
moshiurtonmoy / A-Lightweight-Visual-Font-Style-Recognition-with-Quantized-Convolutional-Autoencoder
A lightweight Convolutional Autoencoder for recognizing Bangla font styles along with quantization for deploying resource-constrained IoT devices.
computer-vision convolutional-autoencoder font-style-recognition quantization-aware-training tensorflow-lite visual-font-recognition
Language:Jupyter Notebook 1
yihong1120 / YOLOv8-qat
Quantization Aware Training
cnn pytorch quantization-aware-training yolov8 benchmarking coco-dataset computer-vision dataset-preparation deep-learning gpu-acceleration image-processing model-comparison model-evaluation model-weights object-detection performance-metrics training-and-testing pytorch-ecosystem transfer-learning deep-learning-frameworks
Language:Python 1

quantization-aware-training

666DZY666 / micronet

intel / neural-compressor

openvinotoolkit / nncf

alibaba / TinyNeuralNetwork

SpursLipu / YOLOv3v4-ModelCompression-MultidatasetTraining-Multibackbone

megvii-research / Sparsebit

fastmachinelearning / hls4ml-tutorial

Beomi / BitNet-Transformers

THU-MIG / torch-model-compression

sayakpaul / Adventures-in-TensorFlow-Lite

clovaai / frostnet

openvinotoolkit / mmdetection

jahongir7174 / YOLOv8-qat

mlzxy / qsparse

yashbhalgat / QualcommAI-MicroNet-submission-MixNet

jeshraghian / QSNNs

DeadAt0m / LSQFakeQuantize-PyTorch

hkproj / quantization-notes

bharathsudharsan / CNN_on_MCU

HaoranREN / TensorFlow_Model_Quantization

Intelligent-Microsystems-Lab / SNNQuantPrune

rishivar / Resnet-18

HanByulKim / BASQ

gulabpatel / Knowledge_Distillation

LorenzoValente3 / Autoencoder-for-FPGA

SangbumChoi / PyTorch_Quantization

yashbhalgat / QualcommAI-MicroNet-submission-EfficientNet

yester31 / Quantization_EX

etetteh / OoD_Gen-Chest_Xray

LorenzoValente3 / JointVAE4AD

marekninja / master-thesis

satya15july / quantization

yashmaniya0 / Quantization-of-Image-Classification-Models

lix19937 / pytorch-quantization

moshiurtonmoy / A-Lightweight-Visual-Font-Style-Recognition-with-Quantized-Convolutional-Autoencoder

yihong1120 / YOLOv8-qat