ZhangLeUestc / TorchDistiller

TorchDistiller

This project is a collection of the open source pytorch code for knowledge distillation, especially for the perception tasks, including semantic segmentation, depth estimation, object detection and instance segmentation.

Collection papers and codebase

Semantic Segmentation

• Structured Knowledge Distillation for Semantic Segmentation, CVPR2019 [paper] [code]
• Intra-class Feature Variation Distillation for Semantic Segmentation, ECCV2020 [paper] [code]
• Channel-wise Knowledge Distillation for Dense Prediction, ICCV2021 [paper] [code]
• Knowledge Distillation based on MMsegmentation [code]

Object Detection and Instance Segmentation

• Knowledge Distillation based on MMdetection [code]
• Knowledge Distillation based on Adet [code]

Update History

• 2021.08.20 Release the code for channel-wise distillation for semantic segmentation

We are integrating more of our work and other great studies into this project.

TO DO LIST

• Distillation on FCOS
• Distillation on CondInst

Contribute

To contribute, PR is appreciated and suggestions are welcome to discuss with.