WXinlong / DenseCL

Dense Contrastive Learning (DenseCL) for self-supervised representation learning, CVPR 2021 Oral.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Question in equation (1) and (2)

tghong opened this issue · comments

Thanks for the great work!

I have a question in equation (1) and (2) in the paper.
In the denominators of these equations, why the temperature hyper-parameter \tau is not used in the "exp(q·k_+)" and "exp(r^s·t^s_+)"?
In https://github.com/WXinlong/DenseCL/blob/main/openselfsup/models/heads/contrastive_head.py#L34, it seems that \tau is applied to all key features.

Hi, thanks for pointing it out!
It's a typo and we will correct it in our next version.

OK. Thank you!