4uiiurz1 / pytorch-lars

PyTorch implementation of LARS (Layer-wise Adaptive Rate Scaling)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Performance on Imagenet

Shiweiliuiiiiiii opened this issue · comments

Hi, thank you very much for your implementation.
Have you ever tested this implementation with Resnet50 on Imagenet? Can this implementation reach the state-of-the-art performance reported in the original paper?

@Shiweiliuiiiiiii I don't have the environment to train ImageNet with large mini-batch sizes, so I haven't been able to try it.