Fluctuating training loss

[299792459b]

Red is training loss
Orange is valid loss

Other datasets show same behavior

Training loss fluctuates up and down drastically. Anyone know why is this happening? Thank you

[Arghyadeep Giri]

Try lowering learning rate.

[Aidos Sarsembayev]

Try lowering learning rate.

which parameter in config is actually LR?