salesforce / LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Where are the loss functions for ITC, ITM, and ITG in the first stage of training in blip2?

nuocheng opened this issue · comments

Hello, I have carefully read articles about blip2, which has sparked a great interest in me. Also looked at the relevant core code of q transformer in blip2. I have a question and I need your help.
I found the use of cross entropy loss in the experimental section of the blip2 article, but I did not find the loss section in the code.
image