activation-functions

There are 4 repositories under activation-functions topic.

Mish
digantamisra98 / Mish
Official Repository for "Mish: A Self Regularized Non-Monotonic Neural Activation Function" [BMVC 2020]
deep-learning activation-functions mathematics neural-networks computer-vision bmvc bmvc20 object-detection image-classification
Language:Jupyter Notebook 1301
lucidrains / siren-pytorch
Pytorch implementation of SIREN - Implicit Neural Representations with Periodic Activation Function
artificial-intelligence deep-learning activation-functions
Language:Python 505
harleyszhang / dl_note
深度学习系统笔记，包含深度学习数学基础知识、神经网络基础部件详解、深度学习炼丹策略、模型压缩算法详解。
cnn convolutional-neural-networks deep-learning pytorch activation-functions inference-framework loss-functions machine-learning cpp python
Language:Python 499
Rethinking-Inpainting-MEDFE
KumapowerLIU / Rethinking-Inpainting-MEDFE
Rethinking Image Inpainting via a Mutual Encoder Decoder with Feature Equalizations. ECCV 2020 Oral
inpainting activation-functions generative-adversarial-network eccv-2020
Language:Python 373
dalmia / siren
PyTorch implementation of Sinusodial Representation networks (SIREN)
machine-learning deep-learning pytorch activation-functions
Language:Python 264
Niranjankumar-c / DeepLearning-PadhAI
All the code files related to the deep learning course from PadhAI
python activation-functions weight-initialization xavier-initializer he-initializer cnn-classification lstm-neural-networks pytorch-cnn pytorch-tutorials
Language:Jupyter Notebook 102
Wongi-Choi1014 / Korean-OCR-Model-Design-based-on-Keras-CNN
Korean OCR Model Design(한글 OCR 모델 설계)
keras cnn korean ocr integer-encoding deep-learning recognition activate activation-functions convolutional-neural-networks dataset gpu-tensorflow one-hot-encoding training
Language:Python 84
densechen / AReLU
AReLU: Attention-based-Rectified-Linear-Unit
pytorch activation-functions deep-learning attention-mechanism transfer-learning ai python attention meta-learning
Language:Jupyter Notebook 62
scart97 / Siren-fastai2
Unofficial implementation of 'Implicit Neural Representations with Periodic Activation Functions'
fastai2 pytorch deep-learning activation-functions
Language:Jupyter Notebook 52
AKASH2907 / Introduction_to_Deep_Learning_Coursera
Intro to Deep Learning by National Research University Higher School of Economics
deep-learning keras tensorflow neural-network optimization linear-regression activation-functions cnn rnn autoencoders image-captioning coursera assignment
Language:Jupyter Notebook 37
M-68 / ActivationFunctions
Implementing activation functions from scratch in Tensorflow.
activation-functions tensorflow-tutorials tensorflow deep-neural-networks keras-tutorials keras-layer
Language:Jupyter Notebook 36
soumik12345 / Pix2Pix
Image to Image Translation using Conditional GANs (Pix2Pix) implemented using Tensorflow 2.0
pix2pix gan conditional-gan tensorflow keras tensorflow-pix2pix image-translation google-maps cityscapes mish activation-functions
Language:Jupyter Notebook 29
XAheli / Predicting-Indian-Stocks-Price-with-Stacked-LSTM
Predicting Indian stock prices using Stacked LSTM model. Analysing Reliance, Tata Steel, HDFC Bank, Infosys data. Data prep, EDA, hyperparameter tuning.
activation-functions hidden-layers hyperparameter-optimization hyperparameter-tuning indian-stock-market lstm-neural-networks machine-learning optimisation stock-price-prediction lstm
Language:Jupyter Notebook 28
pouyaardehkhani / ActTensor
ActTensor: Activation Functions for TensorFlow. https://pypi.org/project/ActTensor-tf/ Authors: Pouya Ardehkhani, Pegah Ardehkhani
activation activation-function activation-functions activations data-science deep-learning deep-neural-networks neural-networks python tensorflow neural-network-architectures python-library python-package tensorflow2 activation-methods deeplearning python3 activation-code ai artificial-intelligence
Language:Python 26
poopingface / sigmoidcolon
:poop: Sigmoid Colon: The biologically inspired activation function.
activation-functions machine-learning
Language:Python 25
epishchik / TrainableActivation
Implementation for the article "Trainable Activations for Image Classification"
activation-functions pytorch cifar-10 convolutional-neural-networks deep-neural-networks mnist resnet
Language:Python 24
NET
okozelsk / NET
Reservoir computing library for .NET. Enables ESN , LSM and hybrid RNNs using analog and spiking neurons working together.
reservoir-computing echo-state-networks liquid-state-machines feedforward-neural-network activation-functions recurrent-neural-networks regression machine-learning machine-learning-library spiking-neural-networks time-series-forecasting time-series-classification classification multiclass-classification prediction deep-learning csharp dotnet-standard
Language:C# 23
ChristophReich1996 / SmeLU
PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations" [arXiv 2022].
activation-functions deep-learning neural-network
Language:Python 22
Rishit-dagli / GLU
An easy-to-use library for GLU (Gated Linear Units) and GLU variants in TensorFlow.
activation-functions deep-learning glu machine-learning neural-network artificial-intelligence keras tensorflow transformers python
Language:Python 20
AaltoML / PeriodicBNN
Code for 'Periodic Activation Functions Induce Stationarity' (NeurIPS 2021)
machine-learning neural-network deep-learning activation-functions
Language:Jupyter Notebook 19
MrGoriay / pwlu-pytorch
Unofficial pytorch implementation of Piecewise Linear Unit dynamic activation function
machine-learning pytorch activation-functions
Language:Python 19
ThomasMrY / ActivationFunctionDemo
[TCAD 2018] Code for “Design Space Exploration of Neural Network Activation Function Circuits”
activation-functions logic-circuit neural-networks pytorch
Language:Python 18
Ameobea / rnn-viz
Interactive visualizations and demos that are used in a blog post I wrote about logic in the context of neural networks
activation-functions canvas echarts neural-network svelte sveltejs sveltekit tensorflow tf tfjs threejs tinygrad uplot webassembly
Language:Jupyter Notebook 17
luca-parisi / quantum_relu
QReLU and m-QReLU: Two novel quantum activation functions for Deep Learning in TensorFlow, Keras, and PyTorch
deep-neural-networks tensorflow keras relu relu-layer relu-activation activation activation-functions quantum quantum-algorithms quantum-machine-learning keras-tensorflow keras-neural-networks keras-models keras-classification-models neural-network neural-networks deep-learning pytorch torch
Language:Python 17
shuuchen / frelu.pytorch
A PyTorch implementation of funnel activation https://arxiv.org/pdf/2007.11824.pdf
activation-functions cnn
Language:Python 14
kumar-shridhar / ProbAct-Probabilistic-Activation-Function
Official PyTorch implementation of the paper : ProbAct: A Probabilistic Activation Function for Deep Neural Networks.
pytorch python probabilistic-programming convolutional-neural-networks activation-functions
Language:Jupyter Notebook 13
lucylow / salty-wet-man
Binary classification to filter and block unsolicited NSFW content from annoying coworkers... --- ...
nsfw tensorflow image-classification keras image-processing image-recognition image-analysis neural-network image-manipulation tensorflow-js gradient gradient-activation waifu-dataset activation-functions imagenet-classifier imagenet imagenet-classification-challenge vgg16 data-augmentation qbic
Language:JavaScript 13
NikolasMarkou / dl_techniques
Advanced deep learning learning techniques, layers, activations loss functions, all in keras / tensorflow
activation-functions deep-learning deep-neural-networks keras keras-models keras-neural-networks keras-tensorflow loss-functions python tensorflow transformers
Language:Python 12
SensorOrgNet / Universal_Activation_Function
Source for the paper "Universal Activation Function for machine learning"
pytorch deep-learning tensorflow tensorflow2 activation-functions activation-function universal-activation-function python python3
Language:Python 11
zohreazimi / Daily-Neural-Network-Exercise
My Daily Neural Network Exercise
activation-functions cnn cnn-model computer-vision data-science dateset deep-learning image-classification jupyter-notebook keras machine-learning model-training neural-networks-convolutional optimizer python pytorch tensorflow torch
Language:Jupyter Notebook 9
MainakRepositor / Activation-Infopedia
activation-functions deep-learning desmos-calculator from-scratch graphs neural-network pseudocode streamlit-webapp
Language:Python 8
mlpapers / neural-nets
Awesome papers on Neural Networks and Deep Learning
neural-networks deep-learning perceptron lstm autoencoders gan bnn bayesian-neural-networks activation-functions awesome awesome-list
8
mohamedamine99 / Visualizing-what-convnets-learn
This Github repository explains the impact of different activation functions on CNN's performance and provides visualizations of activations, convnet filters, and heatmaps of class activation for easier understanding of how CNN works.
activation-functions cnn-keras deep-learning jupyter-notebook
Language:Jupyter Notebook 8
ChristophReich1996 / Pade-Activation-Unit
PyTorch reimplementation of the paper "Padé Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networks" [ICLR 2020].
activation-functions deep-learning deep-neural-networks neural-network pau
Language:Python 7
ChristophReich1996 / SmeLU-Triton
Triton reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations" [arXiv 2022].
deep-learning nerual-network activation-functions triton
Language:Python 7
RahulBhalley / deep-learning-with-swift-for-tensorflow-book
Official source code for "Deep Learning with Swift for TensorFlow" 📖
swift tensorflow swift-for-tensorflow deep-learning deep-neural-networks machine-learning loss-functions activation-functions optimization-methods regularization automatic-differentiation forward-mode reverse-mode convolutional-neural-networks cnn s4tf
Language:Swift 7

activation-functions

digantamisra98 / Mish

lucidrains / siren-pytorch

harleyszhang / dl_note

KumapowerLIU / Rethinking-Inpainting-MEDFE

dalmia / siren

Niranjankumar-c / DeepLearning-PadhAI

Wongi-Choi1014 / Korean-OCR-Model-Design-based-on-Keras-CNN

densechen / AReLU

scart97 / Siren-fastai2

AKASH2907 / Introduction_to_Deep_Learning_Coursera

M-68 / ActivationFunctions

soumik12345 / Pix2Pix

XAheli / Predicting-Indian-Stocks-Price-with-Stacked-LSTM

pouyaardehkhani / ActTensor

poopingface / sigmoidcolon

epishchik / TrainableActivation

okozelsk / NET

ChristophReich1996 / SmeLU

Rishit-dagli / GLU

AaltoML / PeriodicBNN

MrGoriay / pwlu-pytorch

ThomasMrY / ActivationFunctionDemo

Ameobea / rnn-viz

luca-parisi / quantum_relu

shuuchen / frelu.pytorch

kumar-shridhar / ProbAct-Probabilistic-Activation-Function

lucylow / salty-wet-man

NikolasMarkou / dl_techniques

SensorOrgNet / Universal_Activation_Function

zohreazimi / Daily-Neural-Network-Exercise

MainakRepositor / Activation-Infopedia

mlpapers / neural-nets

mohamedamine99 / Visualizing-what-convnets-learn

ChristophReich1996 / Pade-Activation-Unit

ChristophReich1996 / SmeLU-Triton

RahulBhalley / deep-learning-with-swift-for-tensorflow-book