Weight initialization problem

[YIRuriZhongtian]

hi, I noticed that the code when initializing the weights is different from AttnGAN. Can you tell me the reason for doing this?

T2I_CL/AttnGAN+CL/code/miscc/utils.py

Lines 290 to 295 in 6f749b8

 if classname.find('Conv') != -1: 
     #print(m.state_dict().keys()) 
     if list(m.state_dict().keys())[0] == 'weight': 
         nn.init.orthogonal_(m.weight.data, 1.0) 
     elif m.state_dict().keys()[3] == 'weight_bar': 
         nn.init.orthogonal_(m.weight_bar.data, 1.0) 

[huiyegit]

I think the weights may have the Dictionary type to store them, then we can use different keys (.i.e ''weight'' and ''weight_bar'') to get the values(weights).

[YIRuriZhongtian]

Thank you for your reply. Sorry, I still don’t understand the difference between these two.

    if classname.find('Conv') != -1:
        nn.init.orthogonal_(m.weight.data, 1.0)

Can I think that they have the same effect?

[huiyegit]

I think so. It is the same way to initialize the weight of 'Conv' layer.

[YIRuriZhongtian]

ok, thank you!