Zasder3 / train-CLIP

A PyTorch Lightning solution to training OpenAI's CLIP from scratch.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Explanation

Akashcodes732 opened this issue · comments

Can you please add the little more detailed explanation of the code and the self-distillation technique used to make it more efficient.
Various parts of the code are somewhat hard to understand and thus I would request you add some explanation regarding the code as well.