implementation of the activation functions in Fortran 2008
| name | REAL32 |
REAL64 |
pure |
elemental |
note |
|---|---|---|---|---|---|
der_gelu |
✔️ | ✔️ | ✔️ | ✔️ | derivative of gaussian error linear unit function |
der_log_sigmoid |
✔️ | ✔️ | ✔️ | ✔️ | derivative of log simgoid function |
der_lrelu |
✔️ | ✔️ | ✔️ | ✔️ | derivative of leaky rectified linear unit function |
der_prelu |
✔️ | ✔️ | ✔️ | ✔️ | derivative of parametric rectified linear unit function |
der_relu |
✔️ | ✔️ | ✔️ | ✔️ | derivative of rectified linear unit function |
der_silu |
✔️ | ✔️ | ✔️ | ✔️ | derivative of sigmoid linear unit function |
der_softplus |
✔️ | ✔️ | ✔️ | ✔️ | derivative of softplus function |
der_softsign |
✔️ | ✔️ | ✔️ | ✔️ | derivative of softsign function |
der_std_sigmoid |
✔️ | ✔️ | ✔️ | ✔️ | derivative of standard sigmoid function |
der_tanh |
✔️ | ✔️ | ✔️ | ✔️ | derivative of hyperbolic tangent |
gelu |
✔️ | ✔️ | ✔️ | ✔️ | gaussian error linear unit function |
lrelu |
✔️ | ✔️ | ✔️ | ✔️ | leaky rectified linear unit function |
log_sigmoid |
✔️ | ✔️ | ✔️ | ✔️ | log sigmoid function |
prelu |
✔️ | ✔️ | ✔️ | ✔️ | parametric rectified linear unit function |
relu |
✔️ | ✔️ | ✔️ | ✔️ | rectified linear unit function |
silu |
✔️ | ✔️ | ✔️ | ✔️ | sigmoid linear unit function |
softplus |
✔️ | ✔️ | ✔️ | ✔️ | softplus function |
softsign |
✔️ | ✔️ | ✔️ | ✔️ | softsign function |
std_sigmoid |
✔️ | ✔️ | ✔️ | ✔️ | standard sigmoid function |
std_step |
✔️ | ✔️ | ✔️ | ✔️ | standard step function |