loss is vibrating during training with one gpu
cbyzju opened this issue · comments
cbyzju commented
hi,
The loss keeps vibrating during training with one gpu, do you have any suggestions to solve the problem? training dataset is coco, thx!
fenglinglwb commented
You can enlarge the batch size or extend the warm-up.
henbucuoshanghai commented
how long it takes to train coco data with one gpu ?
fenglinglwb commented
Maybe a week? You can adjust training epochs to make it faster.
henbucuoshanghai commented
it is not good when the epochs is 5 or less?