ChristophReich1996 / SmeLU

PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations" [arXiv 2022].

Home Page:https://arxiv.org/pdf/2202.06499.pdf

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ChristophReich1996/SmeLU Stargazers