karanchahal / distiller

A large scale study of Knowledge Distillation.

karanchahal/distiller Issues

Using Distillation on a differenta dataset using a trained teacher.
Updated 4 years ago2
Pytorch lightning?
Updated 4 years ago2
Is it possible to train a smaller model (student)?
Closed 4 years ago1
Is it possible to keep the learing rate constant?
Closed 4 years ago3
Trouble training teaches
Closed 4 years ago4