Giters

facebookresearch / LaViLa

Code release for "Learning Video Representations from Large Language Models"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Pretrained weight of HowTo100M

HYUNJS opened this issue · comments

commented

May I ask if you plan to release the pre-trained weights of Narrator and dual-encoder of HowTo100M?

Thank you for sharing your great work!

commented

Hi @HYUNJS ,

Thanks for your interests in our work.

For the pre-trained weight of HT-100M Narrator, please check out the 3rd-person video narrating demo, or more precisely the following lines in demo_narrator_3rd_person.py.

For the dual-encoder, it might be hard to retrieve the pre-trained weights since I don't have access to the internal storage any more. I might reproduce it later when I have time but I cannot guarantee you a specific timeline. However, do feel free to let me know if you have any question about the details.

Best,
Yue

commented

Thank you for your answer!

commented

Are model weights for the dual-encoder available yet?