lucidrains / g-mlp-pytorch

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

pre-trained model

davidmrau opened this issue · comments

Thanks for your amazing work. Has anyone trained the LM already? In other words is a pre-trained gMLP available?

@davidmrau not at the moment David! the official repo isn't even out yet

Thanks for the quick response!