yoshitomo-matsubara / torchdistill

A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆25 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.

https://yoshitomo-matsubara.net/torchdistill/

Repository from Github https://github.comyoshitomo-matsubara/torchdistill

yoshitomo-matsubara/torchdistill Issues

accuracy change
Closed 23 days ago3
The same seed has different output results twice
Closed a month ago2
Why is the random seed not working? The output results are different every time.
Closed a month ago1
get an error
Closed 7 months ago6
Hi @cxchen100 ,
Closed 7 months ago1
Possible re-implementation of KD w/ LS
Closed 9 months ago4
Knowledge distillation related
Closed 9 months ago1
[BUG] Problems in DistillationBox
Closed 10 months ago2
[BUG] Importing ForwardHookManager messes up logging to file globally
Closed 10 months ago2
Incorrect conditional judgement
Closed 10 months ago2
About the application scenarios supported by the program
Closed a year ago1
[BUG] ModuleNotFoundError: No module named 'torch._six'
Closed a year ago3
is tochdistill support knowlede distillation for Vision Foundation Models like Grounding Dino / Grounding DinoSAM ?
Closed a year ago1
[BUG]ImportError: cannot import name 'import_dependencies' from 'torchdistill.common.main_util'
Closed 2 years ago2
[BUG] Missing Link in Readme
Closed 2 years ago1
[BUG] fp16 causes AssertionError: No inf checks were recorded for this optimizer
Closed 2 years ago4
I tried with this script also, only single nproc seems to be working. Do i need to define any additional enviornment variables like RANK or LocaL HOST
Closed 2 years ago1
[BUG] Not supported to Nvidia 4090
Closed 2 years ago1
How should I use Torchdistill？
Closed 2 years ago1
Not a bug but a discrepency between the log and config file for kd-resnet18_from_resnet34
Closed 2 years ago1
Where is trained model?
Closed 2 years ago1
Custom Data
Closed 2 years ago1
Use different models as Teacher/Student
Closed 3 years ago1
Disagreement betweeen the log and configuration of kd-resnet18_from_resnet34
Closed 3 years ago1
ValueError: batchmean is not a valid value for reduction
Closed 3 years ago1
Why using `log_softmax` instead of `softmax`?
Closed 3 years ago1
How to train my own COCO dataset for object detection?
Closed 3 years ago1
Similarity Preserving KD
Closed 3 years ago2
Inquiry about "CacheableDataset from wrapper"
Closed 3 years ago3
Is it possible to use a model with YOLO framework?
Closed 3 years ago4
Combine two distillation losses
Closed 3 years ago9
How to run my own dataset using the object detection example?
Closed 3 years ago24
If the Teacher model is different from Student model, how can I use this framework？
Closed 3 years ago2
Bug. Bad implement.
Closed 3 years ago2
Distilling Knowledge from a image classification model with sigmoid function and binary cross entropy
Closed 3 years ago3
It seems some bug in `split_dataset`
Closed 3 years ago1
Affinity Loss usage
Closed 3 years ago2
Drop Fully Connected Layer of a Pretrained model
Closed 3 years ago5
Hyperparameters tunning
Closed 3 years ago3
Using forward hook for auxiliary loss
Closed 4 years ago2
Implementation of SemCKD
Closed 4 years ago7
Support for SSD Object Detection Model?
Closed 4 years ago3
How to use different methods for a single task?
Closed 4 years ago15
CSE-L2 KD mobilenetv2 from resnet18 on cifar100
Closed 4 years ago2
How to specify the weight of the downloaded teacher model without access to the Internet?
Closed 4 years ago1
AssertionError: DistributedDataParallel is not needed when a module doesn't have any parameter that requires a gradient.
Closed 4 years ago2
Segmentation fault encountered when entering the second epoch with num_workers>0
Closed 4 years ago5
RuntimeError: CUDA error: device-side assert triggered
Closed 4 years ago8
About dockerfile of torchdistill
Closed 4 years ago1
AttributeError: 'dict' object has no attribute 'flatten'
Closed 4 years ago2