what's "nbs" mean?
kywish opened this issue · comments
kywish commented
这段 调整学习率的地方没看懂:
#-------------------------------------------------------------------#
# 判断当前batch_size,自适应调整学习率
#-------------------------------------------------------------------#
nbs = 16
lr_limit_max = 1e-4 if optimizer_type == 'adam' else 1e-1
lr_limit_min = 1e-4 if optimizer_type == 'adam' else 5e-4
Init_lr_fit = min(max(batch_size / nbs * Init_lr, lr_limit_min), lr_limit_max)
Min_lr_fit = min(max(batch_size / nbs * Min_lr, lr_limit_min * 1e-2), lr_limit_max * 1e-2)
nbs是啥意思吗,为啥要batch_size除以nbs再×初始学习率?
Bubbliiiing commented
一个学习率调节的方式,nbs只是个预先设定好的值