Giters

lucidrains / g-mlp-pytorch

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Potentially missing the high way pass

Vincent-Li-9701 opened this issue · comments

commented

Hello,

Maybe I missed it, but would you mind pointing out where the high way pass of the gMLP block is in the code? Based on the paper, there is a high way path (addition) between the input and the output. I couldn't find it in the gMLPBlock code.

Thank you