Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool
tonyyunyang opened this issue 4 months ago · comments
May I ask why the PreNorm is removed? I am very curious about the reason. As the Transformer encoder is different from the architecture as shown below, which is from the original paper.