`_initialize_weights` not working for the whole model
ngoctnq opened this issue · comments
By construction, the Sequential
, SEModule
, and Bottleneck
modules are not custom-initialized.
By construction, the
Sequential
,SEModule
, andBottleneck
modules are not custom-initialized.
Please refer to https://pytorch.org/docs/stable/generated/torch.nn.Module.html?highlight=modules#torch.nn.Module.modules, it will initialize the conv
, linear
and BN
in Sequential
, SEModule
and Bottleneck
.
Well I'll be damned. Just tested and you're right, sorry for this confusing ticket.