quantization

There are 16 repositories under quantization topic.

kornelski / pngquant
Lossy PNG compressor — pngquant command based on libimagequant library
pngquant quality png png-compression quantization stdin palette smaller conversion image-optimization c
Language:C 4570
IntelLabs / distiller
Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller
automl-for-compression deep-neural-networks distillation early-exit group-lasso jupyter-notebook network-compression onnx pruning pruning-structures pytorch quantization regularization truncated-svd
Language:Jupyter Notebook 4109
nlp-architect
IntelLabs / nlp-architect
A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks
deeplearning nlp nlu tensorflow dynet deep-learning pytorch bert transformers quantization
Language:Python 2887
huawei-noah / Pretrained-Language-Model
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
knowledge-distillation model-compression quantization pretrained-models large-scale-distributed
Language:Python 2609
aaron-xichen / pytorch-playground
Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)
pytorch-tutorial pytorch-tutorials pytorch quantization
Language:Python 2390
nebuly-ai / nebullvm
Plug and play modules to optimize the performances of your AI systems 🚀
deep-learning pytorch onnx machine-learning tensorflow tvm openvino tensorrt huggingface compiler computing inference neural-network pypi quantization edge-computing gpu optimization transformers
Language:Python 2197
666DZY666 / micronet
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
quantization pruning dorefa twn bnn xnor-net pytorch model-compression group-convolution network-slimming neuromorphic-computing convolutional-networks network-in-network integer-arithmetic-only quantization-aware-training post-training-quantization tensorrt onnx tensorrt-int8-python batch-normalization-fuse
Language:Python 1957
tensorflow / model-optimization
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
compression deep-learning keras machine-learning ml model-compression optimization pruning quantization quantized-networks quantized-neural-networks quantized-training sparsity tensorflow
Language:Python 1361
quic / aimet
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
quantization deep-learning compression open-source machine-learning pruning auto-ml network-compression deep-neural-networks network-quantization opensource
Language:Python 1314
PaddlePaddle / PaddleSlim
PaddleSlim is an open-source library for deep model compression and architecture search.
pruning quantization nas bert compression detection distillation ernie segmentation sparsity tensorrt transformer yolov6 yolov5 yolov7
Language:Python 1270
deepsparse
neuralmagic / deepsparse
Inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your application
ml machinelearning pytorch tensorflow onnx deepsparse-engine sparsified-models sparsification-recipe inference computer-vision object-detection pruning quantization pretrained-models nlp auto-ml cpus yolov3 sparsification cpu-inference-api
Language:Python 1257
openvinotoolkit / training_extensions
Trainable models and NN optimization tools
computer-vision deep-learning detection face-recognition neural-networks-compression openvino pytorch quantization segmentation sparsity ssd super-resolution tensorflow text-detection text-recognition
Language:Python 1040
huggingface / optimum
🏎️ Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools
graphcore habana inference intel onnx onnxruntime optimization pytorch quantization training transformers
Language:Python 908
intel / neural-compressor
Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, sparsity, pruning, knowledge distillation, across different deep learning frameworks to pursue optimal inference performance.
low-precision pruning sparsity auto-tuning knowledge-distillation quantization quantization-aware-training post-training-quantization deep-learning
Language:Python 902
htqin / awesome-model-quantization
A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.
awesome binarization binarized-neural-networks binary-network deep-learning efficient-deep-learning lightweight-neural-network model-acceleration model-compression model-quantization quantization
870
guan-yuan / awesome-AutoML-and-Lightweight-Models
A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hyperparameter Optimization, 5.) Automated Feature Engineering.
automl meta-learning automated-feature-engineering hyperparameter-optimization architecture-search model-compression model-acceleration awesome-list neural-architecture-search nas pytorch quantization quantized-neural-network quantized-training tensorflow
791
Xilinx / brevitas
Brevitas: quantization-aware training in PyTorch
quantization pytorch brevitas fpga neural-networks speech-recognition text-to-speech image-classification hardware-acceleration xilinx
Language:Python 777
openppl-public / ppq
PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.
caffe cuda deep-learning neural-network onnx open-source pytorch quantization
Language:Python 655
csarron / awesome-emdl
Embedded and mobile deep learning research resources
efficient-neural-networks deep-neural-networks deep-learning mobile-ai embedded-ai mobile-inference mobile-deep-learning pruning quantization neural-network-compression inference
632
intel / intel-extension-for-pytorch
A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
deep-learning intel machine-learning neural-network pytorch quantization
Language:Python 620
ImageOptim / libimagequant
Palette quantization library that powers pngquant and other PNG optimizers
quantization quality palette rgba-pixels palette-generation minification pixel-array image-pixels conversion visual-studio callback image-optimization pngquant
Language:Rust 578
openvinotoolkit / nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
bert classification compression deep-learning hawq mixed-precision-training mmdetection nlp object-detection onnx openvino pruning pytorch quantization quantization-aware-training semantic-segmentation sparsity tensorflow transformers
Language:Python 562
thulab / DeepHash
An Open-Source Package for Deep Learning to Hash (DeepHash)
deep-learning quantization hashing similarity-search
Language:Python 523
DeepVAC / deepvac
PyTorch Project Specification.
pytorch deepvac python tensorboard quantization amp torchscript onnx ncnn coreml ddp tensorrt
Language:Python 512
Xilinx / finn
Dataflow compiler for QNN inference on FPGAs
dataflow quantization fpga compiler neural-network
Language:Python 469
SforAiDl / KD_Lib
A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.
knowledge-distillation model-compression pruning quantization pytorch deep-learning-library machine-learning data-science benchmarking algorithm-implementations
Language:Python 462
google / qkeras
QKeras: a quantization deep learning library for Tensorflow Keras
deep-learning quantization quantized-neural-networks hardware-acceleration quantized-networks tensorflow keras machine-learning asic-design fpga fpga-accelerator accelerator
Language:Python 442
mit-han-lab / tinyengine
[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Device Training Under 256KB Memory
c codegenerator cpp deep-learning microcontroller pytorch tinyml edge-computing neural-architecture-search quantization
Language:C 435
OpenNMT / CTranslate2
Fast inference engine for Transformer models
neural-machine-translation cpp mkl quantization cuda thrust opennmt deep-neural-networks openmp onednn intrinsics avx2 avx parallel-computing gemm neon transformer-models machine-translation deep-learning inference
Language:C++ 416
fastT5
Ki6an / fastT5
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
python t5 onnx onnxruntime quantization fastt5 nlp fast quantized-onnx-models translation question-answering inference-speed pytorch inference deep-learning transformer
Language:Python 415
MPolaris / onnx2tflite
Tool for onnx->keras or onnx->tflite. If tool is useful for you, please star it.
onnx2keras onnx2tflite onnx2tensorflow yolov5 yolov6 yolov7 deployment onnx pytorch2tensorflow quantization
Language:Python 357
caoyue10 / DeepHash-Papers
Must-read papers on deep learning to hash (DeepHash)
deep-learning hashing quantization similarity-search
317
1duo / awesome-ai-infrastructures
Infrastructures™ for Machine Learning Training/Inference in Production.
artificial-intelligence machine-learning deep-learning machine-learning-systems awesome-list deep-learning-framework kubernetes apache-spark apache-arrow apache-mesos pruning quantization knowledge-distillation model-compression federated-learning
309
mit-han-lab / haq
[CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision
quantization automl mixed-precision efficient-model
Language:Python 307
Zhen-Dong / HAWQ
Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.
quantization tvm model-compression distillation quantized-neural-networks pytorch hardware-aware mixed-precision efficient-neural-networks 8-bit 4-bit tensorcore hessian
Language:Python 301
cedrickchee / awesome-ml-model-compression
Awesome machine learning model compression research papers, tools, and learning material.
awesome-list machine-learning model-compression neural-networks pruning quantization
296