activation-functions

There are 4 repositories under activation-functions topic.

Mish
digantamisra98 / Mish
Official Repository for "Mish: A Self Regularized Non-Monotonic Neural Activation Function" [BMVC 2020]
activation-functions bmvc bmvc20 computer-vision deep-learning image-classification mathematics neural-networks object-detection
Language:Jupyter Notebook 1276
lucidrains / siren-pytorch
Pytorch implementation of SIREN - Implicit Neural Representations with Periodic Activation Function
activation-functions artificial-intelligence deep-learning
Language:Python 452
Rethinking-Inpainting-MEDFE
KumapowerLIU / Rethinking-Inpainting-MEDFE
Rethinking Image Inpainting via a Mutual Encoder Decoder with Feature Equalizations. ECCV 2020 Oral
inpainting activation-functions generative-adversarial-network eccv-2020
Language:Python 365
dalmia / siren
PyTorch implementation of Sinusodial Representation networks (SIREN)
activation-functions deep-learning machine-learning pytorch
Language:Python 255
HarleysZhang / dl_note
深度学习系统笔记，包含深度学习数学基础知识、神经网络基础部件详解、深度学习炼丹策略、模型压缩算法详解，以及如何实现深度学习推理框架实战。
cnn convolutional-neural-networks deep-learning pytorch activation-functions inference-framework loss-functions machine-learning cpp python
Language:Python 220
Niranjankumar-c / DeepLearning-PadhAI
All the code files related to the deep learning course from PadhAI
python activation-functions weight-initialization xavier-initializer he-initializer cnn-classification lstm-neural-networks pytorch-cnn pytorch-tutorials
Language:Jupyter Notebook 98
Wongi-Choi1014 / Korean-OCR-Model-Design-based-on-Keras-CNN
Korean OCR Model Design(한글 OCR 모델 설계)
keras cnn korean ocr integer-encoding deep-learning recognition activate activation-functions convolutional-neural-networks dataset gpu-tensorflow one-hot-encoding training
Language:Python 68
densechen / AReLU
AReLU: Attention-based-Rectified-Linear-Unit
activation-functions ai attention attention-mechanism deep-learning meta-learning python pytorch transfer-learning
Language:Jupyter Notebook 61
scart97 / Siren-fastai2
Unofficial implementation of 'Implicit Neural Representations with Periodic Activation Functions'
fastai2 pytorch deep-learning activation-functions
Language:Jupyter Notebook 49
AKASH2907 / Introduction_to_Deep_Learning_Coursera
Intro to Deep Learning by National Research University Higher School of Economics
deep-learning keras tensorflow neural-network optimization linear-regression activation-functions cnn rnn autoencoders image-captioning coursera assignment
Language:Jupyter Notebook 36
M-68 / ActivationFunctions
Implementing activation functions from scratch in Tensorflow.
activation-functions tensorflow-tutorials tensorflow deep-neural-networks keras-tutorials keras-layer
Language:Jupyter Notebook 36
soumik12345 / Pix2Pix
Image to Image Translation using Conditional GANs (Pix2Pix) implemented using Tensorflow 2.0
pix2pix gan conditional-gan tensorflow keras tensorflow-pix2pix image-translation google-maps cityscapes mish activation-functions
Language:Jupyter Notebook 29
poopingface / sigmoidcolon
:poop: Sigmoid Colon: The biologically inspired activation function.
activation-functions machine-learning
Language:Python 25
NET
okozelsk / NET
Reservoir computing library for .NET. Enables ESN , LSM and hybrid RNNs using analog and spiking neurons working together.
activation-functions classification csharp deep-learning dotnet-standard echo-state-networks feedforward-neural-network liquid-state-machines machine-learning machine-learning-library multiclass-classification prediction recurrent-neural-networks regression reservoir-computing spiking-neural-networks time-series-classification time-series-forecasting
Language:C# 23
ChristophReich1996 / SmeLU
PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations" [arXiv 2022].
deep-learning activation-functions neural-network
Language:Python 20
Rishit-dagli / GLU
An easy-to-use library for GLU (Gated Linear Units) and GLU variants in TensorFlow.
activation-functions artificial-intelligence deep-learning glu keras machine-learning neural-network python tensorflow transformers
Language:Python 19
ThomasMrY / ActivationFunctionDemo
[TCAD 2018] Code for “Design Space Exploration of Neural Network Activation Function Circuits”
activation-functions logic-circuit neural-networks pytorch
Language:Python 18
pouyaardehkhani / ActTensor
ActTensor: Activation Functions for TensorFlow. https://pypi.org/project/ActTensor-tf/ Authors: Pouya Ardehkhani, Pegah Ardehkhani
activation activation-function activation-functions activations data-science deep-learning deep-neural-networks neural-networks python tensorflow neural-network-architectures python-library python-package tensorflow2 activation-methods deeplearning python3 activation-code ai artificial-intelligence
Language:Python 17
AaltoML / PeriodicBNN
Code for 'Periodic Activation Functions Induce Stationarity' (NeurIPS 2021)
machine-learning neural-network deep-learning activation-functions
Language:Jupyter Notebook 16
MrGoriay / pwlu-pytorch
Unofficial pytorch implementation of Piecewise Linear Unit dynamic activation function
machine-learning pytorch activation-functions
Language:Python 16
Pe4enIks / TrainableActivation
Implementation for the article "Trainable Activations for Image Classification"
activation-functions pytorch cifar-10 convolutional-neural-networks deep-neural-networks mnist resnet
Language:Python 15
Ameobea / rnn-viz
Interactive visualizations and demos that are used in a blog post I wrote about logic in the context of neural networks
activation-functions canvas echarts neural-network threejs uplot svelte sveltejs sveltekit tf tensorflow webassembly tfjs tinygrad
Language:Jupyter Notebook 14
shuuchen / frelu.pytorch
A PyTorch implementation of funnel activation https://arxiv.org/pdf/2007.11824.pdf
activation-functions cnn
Language:Python 14
XAheli / Predicting-Indian-Stocks-Price-with-Stacked-LSTM
Predicting Indian stock prices using Stacked LSTM model. Analysing Reliance, Tata Steel, HDFC Bank, Infosys data. Data prep, EDA, hyperparameter tuning.
activation-functions hidden-layers hyperparameter-optimization hyperparameter-tuning indian-stock-market lstm-neural-networks machine-learning optimisation stock-price-prediction lstm
Language:Jupyter Notebook 14
kumar-shridhar / ProbAct-Probabilistic-Activation-Function
Official PyTorch implementation of the paper : ProbAct: A Probabilistic Activation Function for Deep Neural Networks.
pytorch python probabilistic-programming convolutional-neural-networks activation-functions
Language:Jupyter Notebook 13
lucylow / salty-wet-man
Binary classification to filter and block unsolicited NSFW content from annoying coworkers... --- ...
nsfw tensorflow image-classification keras image-processing image-recognition image-analysis neural-network image-manipulation tensorflow-js gradient gradient-activation waifu-dataset activation-functions imagenet-classifier imagenet imagenet-classification-challenge vgg16 data-augmentation qbic
Language:JavaScript 13
SensorOrgNet / Universal_Activation_Function
Source for the paper "Universal Activation Function for machine learning"
pytorch deep-learning tensorflow tensorflow2 activation-functions activation-function universal-activation-function python python3
Language:Python 10
luca-parisi / quantum_relu
QReLU and m-QReLU: Two novel quantum activation functions for Deep Learning in TensorFlow and Keras
deep-neural-networks tensorflow keras relu relu-layer relu-activation activation activation-functions quantum quantum-algorithms quantum-machine-learning keras-tensorflow keras-neural-networks keras-models keras-classification-models neural-network neural-networks deep-learning
Language:Python 9
MainakRepositor / Activation-Infopedia
activation-functions deep-learning desmos-calculator from-scratch graphs neural-network pseudocode streamlit-webapp
Language:Python 9
mlpapers / neural-nets
Awesome papers on Neural Networks and Deep Learning
neural-networks deep-learning perceptron lstm autoencoders gan bnn bayesian-neural-networks activation-functions awesome awesome-list
7
mohamedamine99 / Visualizing-what-convnets-learn
This Github repository explains the impact of different activation functions on CNN's performance and provides visualizations of activations, convnet filters, and heatmaps of class activation for easier understanding of how CNN works.
activation-functions cnn-keras deep-learning jupyter-notebook
Language:Jupyter Notebook 7
pkonowrocki / Neural-network
Multilayer neural network framework implementation, used for classification and regression task. Can use multiple activation functions with backpropagation based on autograd library. Contains polynomial activation function for regression task.
neural-network autograd loss-functions activation-functions multilayer-perceptron-network mnist-classification regression classification
Language:Python 6
TechBison / NN-assignment-1
perceptron-learning-algorithm logic-gates-neural-network activation-functions delta-learning-rule python3 neur
Language:Jupyter Notebook 6
ChristophReich1996 / Pade-Activation-Unit
PyTorch reimplementation of the paper "Padé Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networks" [ICLR 2020].
deep-learning deep-neural-networks neural-network pau activation-functions
Language:Python 5
MoinDalvs / Neural_Networks_From_Scratch
Neural_Networks_From_Scratch
activation-functions back-propagation classification gradient-descent hyperparameter-optimization hyperparameter-tuning keras-neural-networks neural-networks optimizer tensorflow weight-initialization activation-function deep-learning machine-learning neural-network optimization-algorithms
Language:Jupyter Notebook 5
RahulBhalley / deep-learning-with-swift-for-tensorflow-book
Official source code for "Deep Learning with Swift for TensorFlow" 📖
swift tensorflow swift-for-tensorflow deep-learning deep-neural-networks machine-learning loss-functions activation-functions optimization-methods regularization automatic-differentiation forward-mode reverse-mode convolutional-neural-networks cnn s4tf
Language:Swift 5

activation-functions

digantamisra98 / Mish

lucidrains / siren-pytorch

KumapowerLIU / Rethinking-Inpainting-MEDFE

dalmia / siren

HarleysZhang / dl_note

Niranjankumar-c / DeepLearning-PadhAI

Wongi-Choi1014 / Korean-OCR-Model-Design-based-on-Keras-CNN

densechen / AReLU

scart97 / Siren-fastai2

AKASH2907 / Introduction_to_Deep_Learning_Coursera

M-68 / ActivationFunctions

soumik12345 / Pix2Pix

poopingface / sigmoidcolon

okozelsk / NET

ChristophReich1996 / SmeLU

Rishit-dagli / GLU

ThomasMrY / ActivationFunctionDemo

pouyaardehkhani / ActTensor

AaltoML / PeriodicBNN

MrGoriay / pwlu-pytorch

Pe4enIks / TrainableActivation

Ameobea / rnn-viz

shuuchen / frelu.pytorch

XAheli / Predicting-Indian-Stocks-Price-with-Stacked-LSTM

kumar-shridhar / ProbAct-Probabilistic-Activation-Function

lucylow / salty-wet-man

SensorOrgNet / Universal_Activation_Function

luca-parisi / quantum_relu

MainakRepositor / Activation-Infopedia

mlpapers / neural-nets

mohamedamine99 / Visualizing-what-convnets-learn

pkonowrocki / Neural-network

TechBison / NN-assignment-1

ChristophReich1996 / Pade-Activation-Unit

MoinDalvs / Neural_Networks_From_Scratch

RahulBhalley / deep-learning-with-swift-for-tensorflow-book