model-compression

There are 54 repositories under model-compression topic.

nni
microsoft / nni
An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
automl deep-learning neural-architecture-search hyperparameter-optimization distributed bayesian-optimization automated-machine-learning machine-learning machine-learning-algorithms data-science tensorflow pytorch neural-network deep-neural-network model-compression feature-engineering nas python feature-extraction hyperparameter-tuning
Language:Python 11487
dkozlov / awesome-knowledge-distillation
Awesome Knowledge Distillation
knowledge-distillation knowledge-transfer teacher-student co-training distillation distillation-model model-distillation knowldge-distillation kd model-compression deep-learning
2777
Tencent / PocketFlow
An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.
automl computer-vision deep-learning mobile-app model-compression
Language:Python 2706
huawei-noah / Pretrained-Language-Model
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
knowledge-distillation large-scale-distributed model-compression pretrained-models quantization
Language:Python 2275
huawei-noah / CV-Backbones
CV backbones including GhostNet, TinyNet and TNT, developed by Huawei Noah's Ark Lab.
convolutional-neural-networks efficient-inference imagenet model-compression cvpr tensorflow pytorch ghostnet transformer pretrained-models vision-transformer
Language:Python 2039
FLHonker / Awesome-Knowledge-Distillation
Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
deep-learning distillation kd knowldge-distillation model-compression transfer-learning
1778
666DZY666 / micronet
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
quantization pruning dorefa twn bnn xnor-net pytorch model-compression group-convolution network-slimming neuromorphic-computing convolutional-networks network-in-network integer-arithmetic-only quantization-aware-training post-training-quantization tensorrt onnx tensorrt-int8-python batch-normalization-fuse
Language:Python 1758
he-y / Awesome-Pruning
A curated list of neural network pruning resources.
awesome-list model-acceleration model-compression pruning
1487
microsoft / NeuronBlocks
NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego
question-answering deep-learning pytorch natural-language-processing text-classification artificial-intelligence dnn qna text-matching knowledge-distillation model-compression sequence-labeling
Language:Python 1410
peterliht / knowledge-distillation-pytorch
A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
pytorch knowledge-distillation deep-neural-networks cifar10 model-compression dark-knowledge computer-vision
Language:Python 1376
tensorflow / model-optimization
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
tensorflow machine-learning deep-learning optimization quantized-neural-networks quantized-networks quantized-training keras model-compression compression ml pruning sparsity quantization
Language:Python 1242
channel-pruning
yihui-he / channel-pruning
Channel Pruning for Accelerating Very Deep Neural Networks (ICCV'17)
acceleration channel-pruning deep-neural-networks image-classification image-recognition model-compression object-detection
Language:Python 1035
AberHu / Knowledge-Distillation-Zoo
Pytorch implementation of various Knowledge Distillation (KD) methods.
distillation kd kd-methods knowledge-distillation knowledge-transfer model-compression teacher-student
Language:Python 944
PaddlePaddle / PaddleSlim
PaddleSlim is an open-source library for deep model compression and architecture search.
autodl hyperparameter-search knowledge-distillation model-compression nas neural-architecture-search pruning quantization
Language:Python 898
guan-yuan / awesome-AutoML-and-Lightweight-Models
A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hyperparameter Optimization, 5.) Automated Feature Engineering.
automl meta-learning automated-feature-engineering hyperparameter-optimization architecture-search model-compression model-acceleration awesome-list neural-architecture-search nas pytorch quantization quantized-neural-network quantized-training tensorflow
764
MingSun-Tse / EfficientDNNs
Collection of recent methods on (deep) neural network compression and acceleration.
model-compression network-pruning knowledge-distillation deep-learning deep-neural-networks
713
cnkuangshi / LightCTR
Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosophy of Parameter Server and Ring-AllReduce collective communication.
machine-learning deep-learning factorization-machines distributed-systems parameter-server model-compression computational-graphs
Language:C++ 665
VainF / Torch-Pruning
Pruning channels for model acceleration
pytorch pruning model-compression network-pruning
Language:Python 518
lhyfst / knowledge-distillation-papers
knowledge distillation papers
knowledge-distillation model-compression paper dark-knowledge reading-list
509
iamhankai / ghostnet.pytorch
[CVPR2020] GhostNet: More Features from Cheap Operations
convolutional-neural-networks fbnet mobilenetv3 model-compression pytorch
Language:Python 477
huawei-noah / Efficient-Computing
Efficient-Computing
knowledge-distillation model-compression
Language:Python 476
he-y / filter-pruning-geometric-median
Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration (CVPR 2019 Oral)
model-compression pruning pytorch
Language:Python 421
SforAiDl / KD_Lib
A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.
knowledge-distillation model-compression pruning quantization pytorch deep-learning-library machine-learning data-science benchmarking algorithm-implementations
Language:Python 381
chester256 / Model-Compression-Papers
Papers for deep neural network compression and acceleration
deep-learning model-compression papers deep-neural-networks model-acceleration
355
microsoft / archai
Archai accelerates Neural Architecture Search (NAS) through fast, reproducible and modular research.
python pytorch machine-learning deep-learning neural-architecture-search nas automated-machine-learning model-compression darts petridish
Language:Python 354
mit-han-lab / amc
[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices
automl automl-for-compression model-compression channel-pruning efficient-model on-device-ai
Language:Python 354
he-y / soft-filter-pruning
Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks
model-compression pruning pytorch
Language:Python 341
1duo / awesome-ai-infrastructures
Infrastructures™ for Machine Learning Training/Inference in Production.
artificial-intelligence machine-learning deep-learning machine-learning-systems awesome-list deep-learning-framework kubernetes apache-spark apache-arrow apache-mesos pruning quantization knowledge-distillation model-compression federated-learning
287
alibaba / TinyNeuralNetwork
TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.
pytorch deep-learning model-compression pruning model-converter quantization-aware-training
Language:Python 276
BERT-of-Theseus
JetRunner / BERT-of-Theseus
⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).
bert glue model-compression nlp transformers
Language:Python 268
cedrickchee / awesome-ml-model-compression
Awesome machine learning model compression research papers, tools, and learning material.
machine-learning model-compression quantization pruning awesome-list neural-networks
239
Zhen-Dong / HAWQ
Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.
quantization tvm model-compression distillation quantized-neural-networks pytorch hardware-aware mixed-precision efficient-neural-networks 8-bit 4-bit tensorcore hessian
Language:Python 225
yehuitang / Pruning
Code for "Co-Evolutionary Compression for Unpaired Image Translation" (ICCV 2019), "SCOP: Scientific Control for Reliable Neural Network Pruning" (NeurIPS 2020) and “Manifold Regularized Dynamic Network Pruning” (CVPR 2021).
network-pruning model-compression
Language:Python 220
vinhkhuc / JFastText
Java interface for fastText
machine-learning nlp java word-embeddings jni text-classification model-compression
Language:Java 203
liuziwei7 / mobile-id
Deep Face Model Compression
computer-vision deep-learning face-recognition model-compression efficient-inference
Language:MATLAB 191
Peterisfar / YOLOV3
yolov3 by pytorch
yolov3 pytorch voc object-detection model-compression mobilenetv2
Language:Python 182

ezoic increase your site revenue

Related Topics

deep-learning pytorch machine-learning recommender-system graph-neural-networks