themrzmaster / git-re-basin-pytorch

Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ResNet50

superkirill opened this issue · comments

Could you also provide a permutation spec for ResNet50?

done it. let me know if it works as expected, my GPU takes a while to train a resnet50.
use depth 52 as an arg

Thanks! My concern is that it's not a very "canonical" implemetation with 4 block groups and varying numbers of channels, so it's hard to use it with official PyTorch models

Yes, it should be easy to use the same logic with resnet from torchvision. Just have to remember to not use batchnorm

Its not working with torchvisions ResNet50. Can you pls help me out
Thanks!

cifar100_resnet52_4_weight_matching_interp_accuracy_epoch
Hi, whem I try ResNet50 on cifar100, the accuracy drops a lot, and permuted accuracy is even worse than naive which is unexpected.