zdaxie / PixPro

Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning, CVPR 2021

Home Page:https://arxiv.org/abs/2011.10043

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Miss SyncBatchNorm in Pixel Propagation Module

Yingdong-Hu opened this issue · comments

self.value_transform = MLP2d(in_dim=256, inner_dim=256, out_dim=256)

If I set pixpro_transform_layer=2, it will use Batchnorm between 2 linear layers, but it seems that you didn't convert this batchnorm to SyncBatchNorm.