Zasder3 / train-CLIP

A PyTorch Lightning solution to training OpenAI's CLIP from scratch.

这里student和teacher是不是搞反了？

zhouwei5113 opened this issue 2 years ago · comments

zhouwei5113 commented 2 years ago

train-CLIP/models/wrapper.py

Line 292 in 8146438

teacher.data.copy_(self.ema(teacher.data, student.data))

Cade Gordon commented 2 years ago

Great catch, looks like it!

Cade Gordon commented 2 years ago

Fixed in latest commit. Thank you :)