akamaster / pytorch_resnet_cifar10

Proper implementation of ResNet-s for CIFAR10/100 in pytorch that matches description of the original paper.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Learning rate for ResNet 110

jakesokol1 opened this issue · comments

I am trying to train resnet110. After the first epoch, the learning rate does not return to .1, and it stays at .01. I believe this is not intended.

I believe this yields expected behavior (if it is actually desired that only the first epoch have learning rate of .01).

for epoch in range(args.start_epoch, args.epochs):
    if epoch == 1:
        for param_group in optimizer.param_groups:
            param_group['lr'] *= 10

`