Detected call of `lr_scheduler.step()` before `optimizer.step()

Question

Detected call of `lr_scheduler.step()` before `optimizer.step()

mmm898 opened this issue 2 years ago · comments

Hi, I run run_pre_training.py and have this problem: "UserWarning: Detected call of lr_scheduler.step() before optimizer.step()". I looked for optimize and scheduler in your repo but didn't find anything. Can you help me to fix this. I'm using transformers 4.3.1

Luyu Gao · Answer 1 · Fri May 06 2022 22:38:30 GMT+0800 (China Standard Time)

This is a typical and benign warning when you run with mixed precision and get a overflow.

mmm898 · Answer 2 · Sat May 07 2022 10:03:36 GMT+0800 (China Standard Time)

Thank you for answering. I will close this issue