facebookresearch / LaViLa

Code release for "Learning Video Representations from Large Language Models"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

The pre-training weights of Dual-Encoder Baseline (with TSF-B/L)

daiguangzhao opened this issue · comments

Thanks so much to the authors for their contributions to the egocentric community! I wanted to use your excellent code as my codebase in my work, but after I removed the pre-training weights (clip_openai_timesformer_base.narrator_rephraser.ep_0005.md5sum_d73a9c.pth), the performance of epic100 became very bad. Therefore, would you mind providing the pre-training weights for Dual-Encoder Baseline (with TSF-B/L)? Thanks a lot!

Hi @daiguangzhao ,

Please take a look at MODEL_ZOO.md#narrator. The second column from the right should hopefully work.

Best,
Yue

thanks for your reply! Thanks again for your excellent contribution to the ego community.