Giters

tinapan-pt / VideoMoCo

Official pytorch implementation of paper "VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples" (CVPR 2021).

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

About other self-supervised framework

EBGU opened this issue · comments

commented

Hi!

I read your paper and it is really great! I am also working with contrast learning applied to videos, and I am trying frameworks that don't need negative samples(like simsiam). I wonder if you have tried those frameworks? My networks suffered from either collapse or no convergence, so I just want to discuss with you.

Thank you!

commented

Simsiam is indeed easier to collapse, you can refer to the methods of preventing collapse in the article "Exploring Simple Siamese Representation Learning".