Tony-Y / pytorch_warmup

Learning Rate Warmup in PyTorch

https://tony-y.github.io/pytorch_warmup/

Tony-Y/pytorch_warmup Issues

A BUG in BaseWarmup?
Closed a month ago8
Nice work!
Closed a month ago1
Can the warmup_scheduler update the learning rate every epoch and not every batch?
Closed 7 months ago2
How to schedule LR with warmup on global_step initially, and then epoches after warmup?
Closed 9 months ago9
About the learning rate in scheduler
Closed 2 years ago1
My lr jumped from 0.01 to 0.0498 without any linear signs.
Closed 2 years ago2
UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`
Closed 2 years ago2
How to use in `pytorch-lightning`?
Closed 2 years ago2
Why did my learning rate drop from the initial lr
Closed 2 years ago3
Unexpected keyword argument `warmup_period`
Closed 2 years ago1
License file is not included in sdist
Closed 2 years ago1
no attribute named dampening
Closed 3 years ago1
UserWarning: The epoch parameter in `scheduler.step()` was not necessary and is being deprecated where possible.
Closed 3 years ago2
difference of this library with hugging face
Closed 3 years ago3
Why is warmup better than RAdam?
Closed 3 years ago3
What is the decay rule of thumb?
Closed 3 years ago3