What is the teacher model when using semantic softmax with KD?
Phuoc-Hoan-Le opened this issue · comments
Phuoc-Hoan Charles Le commented
What is the teacher model when using semantic softmax with KD? The figure in the paper is not clear on what the teacher is. Or in there is no code example on how to use the KD