Giters

facebookresearch / MetaCLIP

ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Experts via Clustering

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Clarification: Does MetaCLIP actually use the updated training method as described in the paper?

shelbywhite opened this issue · comments

commented

Does MetaCLIP actually use the updated training method as described in the paper?

According to the readme of this repo it says: "All MetaCLIP adhere to OpenAI CLIP training setup" which implies that MetaCLIP models shown in this repo don't actually leverage the new technique MetaCLIP uses for training the models itself. I hope this is not the case, but would be helpful to clarify what this statement means.

commented

what do you mean by "updated training method"? we didn't invent/introduce any "new technique" but follow OpenAI training recipe closely to avoid confounding factors on optimization/lr etc. that was used by other open source CLIP models than comparing to OpenAI CLIPs.