vballoli / nfnets-pytorch

NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/

Home Page:https://nfnets-pytorch.readthedocs.io/en/latest/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Feature request for WSConvTranspose2d

hadaev8 opened this issue · comments

commented

Describe the solution you'd like
I would like to have transposed version.

Additional context
Want to test how it works for gan.

Added here 26d6bd8! Do let me know how it works out for you! It's not in the latest release yet, you'll have to install it as pip install git+ .

It's added to the new release. pip install nfnets-pytorch directly to access the WSConvTranspose2d

commented

Sound like it doesnt work in gan setup.
Thanks for your efforts.

Have you tried only WSConv2d on the discriminator and the normal generator framework @hadaev8 ? I think BatchNorm is probably much more important in generator-like networks.