knowledge-distillation

There are 26 repositories under knowledge-distillation topic.

PaddlePaddle / PaddleClas
A treasure chest for visual recognition powered by PaddlePaddle
autoaugment cutmix deit gridmask image-classification image-recognition image-retrieval-system knowledge-distillation pretrained-models product-recognition randaugment repvgg swin-transformer
Language:Python 3489
dkozlov / awesome-knowledge-distillation
Awesome Knowledge Distillation
knowledge-distillation knowledge-transfer teacher-student co-training distillation distillation-model model-distillation knowldge-distillation kd model-compression deep-learning
2775
huawei-noah / Pretrained-Language-Model
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
knowledge-distillation model-compression quantization pretrained-models large-scale-distributed
Language:Python 2275
microsoft / NeuronBlocks
NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego
question-answering deep-learning pytorch natural-language-processing text-classification artificial-intelligence dnn qna text-matching knowledge-distillation model-compression sequence-labeling
Language:Python 1410
peterliht / knowledge-distillation-pytorch
A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
pytorch knowledge-distillation deep-neural-networks cifar10 model-compression dark-knowledge computer-vision
Language:Python 1375
szagoruyko / attention-transfer
Improving Convolutional Networks via Attention Transfer (ICLR 2017)
pytorch knowledge-distillation attention deep-learning
Language:Jupyter Notebook 1326
AberHu / Knowledge-Distillation-Zoo
Pytorch implementation of various Knowledge Distillation (KD) methods.
kd-methods knowledge-transfer knowledge-distillation kd teacher-student model-compression distillation
Language:Python 943
PaddlePaddle / PaddleSlim
PaddleSlim is an open-source library for deep model compression and architecture search.
model-compression neural-architecture-search knowledge-distillation pruning quantization nas hyperparameter-search autodl
Language:Python 898
lxztju / pytorch_classification
利用pytorch实现图像分类的一个完整的代码，训练，预测，TTA，模型融合，模型部署，cnn提取特征，svm或者随机森林等进行分类，模型蒸馏，一个完整的代码
pytorch image-classification deployment svm knn cnn label-smoothing densenet resnext resnet flask random-forest knowledge-distillation
Language:Jupyter Notebook 883
EasyTransfer
alibaba / EasyTransfer
EasyTransfer is designed to make the development of transfer learning in NLP applications easier.
bert nlp-applications knowledge-distillation transfer-learning
Language:Python 773
MingSun-Tse / EfficientDNNs
Collection of recent methods on (deep) neural network compression and acceleration.
model-compression network-pruning knowledge-distillation deep-learning deep-neural-networks
713
yoshitomo-matsubara / torchdistill
A coding-free framework built on PyTorch for reproducible deep learning studies. 🏆20 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
knowledge-distillation pytorch image-classification imagenet object-detection coco semantic-segmentation cifar10 cifar100 colab-notebook google-colab pascal-voc nlp natural-language-processing transformer glue
Language:Python 630
open-mmlab / mmrazor
OpenMMLab Model Compression Toolbox and Benchmark.
nas pruning knowledge-distillation spos darts autoslim detection segmentation classification pytorch
Language:Python 582
lhyfst / knowledge-distillation-papers
knowledge distillation papers
knowledge-distillation model-compression paper dark-knowledge reading-list
509
huawei-noah / Efficient-Computing
Efficient-Computing
knowledge-distillation model-compression
Language:Python 476
yuanli2333 / Teacher-free-Knowledge-Distillation
Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
knowledge-distillation pytorch teacher-free paper-implementations label-smoothing
Language:Python 434
SforAiDl / KD_Lib
A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.
algorithm-implementations benchmarking data-science deep-learning-library knowledge-distillation machine-learning model-compression pruning pytorch quantization
Language:Python 381
intel / neural-compressor
Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, sparsity, pruning, knowledge distillation, across different deep learning frameworks to pursue optimal inference performance.
low-precision pruning sparsity auto-tuning knowledge-distillation quantization quantization-aware-training post-training-quantization deep-learning
Language:Python 365
clovaai / overhaul-distillation
Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)
knowledge-distillation knowledge-transfer teacher-student network-compression iccv2019
Language:Python 358
ilovepose / fast-human-pose-estimation.pytorch
Official pytorch Code for CVPR2019 paper "Fast Human Pose Estimation" https://arxiv.org/abs/1811.05419
coco-keypoints-detection deep-learning fast-pose-distillation human-pose-estimation knowledge-distillation mpii-dataset mscoco-keypoint
Language:Cuda 356
yzhao062 / SUOD
(MLSys' 21) An Acceleration System for Large-scare Unsupervised Heterogeneous Outlier Detection (Anomaly Detection)
data-mining machine-learning anomaly-detection outlier-detection distributed-systems knowledge-distillation python machine-learning-algorithms machine-learning-library
Language:Python 321
yuanyuanli85 / Fast_Human_Pose_Estimation_Pytorch
Pytorch Code for CVPR2019 paper "Fast Human Pose Estimation" https://arxiv.org/abs/1811.05419
pytorch knowledge-distillation stacked-hourglass-networks pose-estimation
Language:Python 314
lenscloth / RKD
Official pytorch Implementation of Relational Knowledge Distillation, CVPR 2019
deep-neural-networks computer-vision metric-learning knowledge-distillation deep-learning
Language:Python 311
1duo / awesome-ai-infrastructures
Infrastructures™ for Machine Learning Training/Inference in Production.
artificial-intelligence machine-learning deep-learning machine-learning-systems awesome-list deep-learning-framework kubernetes apache-spark apache-arrow apache-mesos pruning quantization knowledge-distillation model-compression federated-learning
287
KD_methods_with_TF
sseung0703 / KD_methods_with_TF
Knowledge distillation methods implemented with Tensorflow (now there are 11 (+1) methods, and will be added more.)
knowledge-distillation tensorflow-examples tensorflow
Language:Python 254
imirzadeh / Teacher-Assistant-Knowledge-Distillation
Using Teacher Assistants to Improve Knowledge Distillation: https://arxiv.org/pdf/1902.03393.pdf
deep-learning knowledge-distillation neural-network-compression
Language:Python 219
karanchahal / distiller
A large scale study of Knowledge Distillation.
knowledge-distillation feature-distillation pytorch-lightning
Language:Python 202
megvii-research / mdistiller
A Knowledge Distillation Toolbox. The official implementation of https://arxiv.org/abs/2203.08679
computer-vision deep-learning knowledge-distillation pytorch
Language:Jupyter Notebook 194
aimagelab / mammoth
An Extendible (General) Continual Learning Framework based on Pytorch - official codebase of Dark Experience for General Continual Learning
continual-learning dark-experience-replay deep-learning der experience-replay knowledge-distillation neurips2020 pytorch
Language:Python 186
HikariTJU / LD
Localization Distillation for Dense Object Detection (CVPR 2022)
detection knowledge-distillation ld object-detection pytorch deep-learning
Language:Python 185
sebastian-hofstaetter / matchmaker
Training & evaluation library for text-based neural re-ranking and dense retrieval models built with PyTorch
neural-ir transformer explainability efficiency knowledge-distillation dpr pytorch neural-ranking
Language:Python 179
MingSun-Tse / Collaborative-Distillation
[CVPR'20] PyTorch code for our paper "Collaborative Distillation for Ultra-Resolution Universal Style Transfer"
model-compression knowledge-distillation neural-style-transfer low-level-vision
Language:Python 171
nathanhubens / fasterai
FasterAI: Prune and Distill your models with FastAI and PyTorch
pruning compression fastai pytorch knowledge-distillation
Language:Jupyter Notebook 163
yzd-v / FGD
Focal and Global Knowledge Distillation for Detectors (CVPR 2022)
object-detection knowledge-distillation deep-learning pytorch
Language:Python 162
xcfcode / What-I-Have-Read
Paper Lists, Notes and Slides, Focus on NLP. For summarization, please refer to https://github.com/xcfcode/Summarization-Papers
nlp summarization acl emnlp aaai naacl slides presentation gnn knowledge-distillation pretrain gan non-autoregressive generation graph-neural-networks notes presentations data-augmentation meta-learning conversation
149
SsisyphusTao / Object-Detection-Knowledge-Distillation
An Object Detection Knowledge Distillation framework powered by pytorch, now having SSD and yolov5.
pytorch knowledge-distillation ssd object-detection deep-learning yolov5
Language:Python 144

ezoic increase your site revenue

Related Topics

pytorch deep-learning gan computer-vision generative-adversarial-network