Giters

THUDM / SwissArmyTransformer

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

Home Page:https://THUDM.github.io/SwissArmyTransformer

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Problem with default init_method in function _initialize_affine_weight

hanyullai opened this issue · comments

commented

When using default init_method=init.xavier_normal_ in VocabParallelEmbedding, ParallelEmbedding, ColumnParallelLinear, RowParallelLinear, it will report error with " init_method(master_weight, module=module, name=name) TypeError: xavier_normal_() got an unexpected keyword argument 'module' " in function _initialize_affine_weight.

commented

fixed at v0.2.6