adam

There are 2 repositories under adam topic.

LiyuanLucasLiu / RAdam
On the Variance of the Adaptive Learning Rate and Beyond
optimizer adam adam-optimizer warmup
Language:Python 2533
adam
Malinskiy / adam
Adam (or adm) is a coroutine-friendly Android Debug Bridge client written in Kotlin
android adb ddmlib kotlin instrumentation coroutines adam testing testing-tools adm hacktoberfest adblib
Language:Kotlin 430
Tony-Y / pytorch_warmup
Learning Rate Warmup in PyTorch
adam deep-learning learning-rate-scheduling pytorch warmup
Language:Python 376
5hirish / adam_qas
ADAM - A Question Answering System. Inspired from IBM Watson
adam elasticsearch gensim natural-language-processing pandas python question-answering scikit-learn spacy spacy-extension wikipedia
Language:Python 358
CyberZHG / keras-radam
RAdam implemented in Keras & TensorFlow
keras optimizers adam radam rectified-adam tensorflow
Language:Python 324
GSORF / Visual-GPS-SLAM
This is a repo for my master thesis research about the Fusion of Visual SLAM and GPS. It contains the research paper, code and other interesting data.
3d adam blender dso fusion gps ros simulation slam slam-algorithms visual
Language:C++ 294
fujinet-firmware
FujiNetWIFI / fujinet-firmware
8-bit systems to ESP32 WiFi Multifunction Firmware
atari 8bit esp32 esp-idf adam
Language:C 219
Nasdin / ReinforcementLearning-AtariGame
Pytorch LSTM RNN for reinforcement learning to play Atari games from OpenAI Universe. We also use Google Deep Mind's Asynchronous Advantage Actor-Critic (A3C) Algorithm. This is much superior and efficient than DQN and obsoletes it. Can play on many games
a3c a3c-lstm pytorch openai-gym reinforcement-learning universe lstm adam rmsprop reinforcement-learning-algorithms reinforcement-agents python deep-reinforcement-learning actor-critic asynchronous-advantage-actor-critic
Language:Jupyter Notebook 169
jiro-nn
AnicetNgrt / jiro-nn
A Deep Learning and preprocessing framework in Rust with support for CPU and GPU.
adam classification dropout machine-learning ml nalgebra neural-networks nn pipelines regression rust sgd data-analysis cuda deep-learning gpu gpu-computing opencl
Language:Rust 120
GLambard / AdamW_Keras
AdamW optimizer for Keras
adam adamw keras optimizer tensorflow
Language:Python 114
YanaiEliyahu / AdasOptimizer
ADAS is short for Adaptive Step Size, it's an optimizer that unlike other optimizers that just normalize the derivative, it fine-tunes the step size, truly making step size scheduling obsolete, achieving state-of-the-art training performance
optimizer adam adam-optimizer artifical-neural-network deep-learning mnist machine-learning
Language:C++ 84
bentrevett / a-tour-of-pytorch-optimizers
A tour of different optimization algorithms in PyTorch.
pytorch-optimizers optimization optimization-algorithms pytorch sgd adagrad adadelta rmsprop adam
Language:Jupyter Notebook 81
davda54 / ada-hessian
Easy-to-use AdaHessian optimizer (PyTorch)
adahessian hessian optimizer pytorch second-order adam
Language:Python 79
Mrpatekful / swats
Unofficial implementation of Switching from Adam to SGD optimization in PyTorch.
swats pytorch adam sgd optimizer
Language:Python 65
nengwp / Lion-vs-Adam
Lion and Adam optimization comparison
adam adam-optimizer lion lion-optimization vis
Language:Jupyter Notebook 54
polyfem / polysolve
Easy-to-use linear and non-linear solver
cpp eigen linear-solvers wrapper hypre amgcl suitesparse solvers pardiso iterative-solvers adam lbfgs-optimizer linesearch newton nonlinear-optimization stochastic-gradient-descent
Language:C++ 44
shreyansh26 / ML-Optimizers-JAX
Toy implementations of some popular ML optimizers using Python/JAX
jax optimization-algorithms optimizers machine-learning gradient-descent adam-optimizer adam momentum
Language:Python 41
uclaml / Padam
Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks" (accepted by IJCAI 2020)
adam adaptive adaptive-gradient-method gradient padam
Language:Python 39
zmyzheng / Neural-Networks-and-Deep-Learning
Deep learning projects including applications (face recognition, neural style transfer, autonomous driving, sign language reading, music generation, translation, speech recognition and NLP) and theories (CNNs, RNNs, LSTM, Adam, Dropout, BatchNorm, Xavier/He initialization, hyperparameter tuning, regularization, optimization, Residual Networks). Deep Learning Specialization by Andrew Ng, deeplearning.ai
tensorflow keras face-recognition neural-style-transfer autonomous-driving yolo music-generation translation speech-recognition natural-language-processing cnn rnn lstm adam dropout batchnorm xavier-he-initialization hyperparameter-tuning regularization residual-networks
Language:Jupyter Notebook 37
JRC1995 / DemonRangerOptimizer
Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay
qhadam demon decay-momentum adamod radam adam gradient-centralization lookahead amsgrad iterate-averaging adamw ranger qhranger optimizer adaptive-optimizer hypergradient-descent hd-adam hd-sgd nosadam nostalgic-adam
Language:Python 25
harshraj11584 / Paper-Implementation-Overview-Gradient-Descent-Optimization-Sebastian-Ruder
[Python] [arXiv/cs] Paper "An Overview of Gradient Descent Optimization Algorithms" by Sebastian Ruder
adadelta adagrad adam-optimizer adam gradient-descent gradient-boosting gradient-descent-algorithm optimization-algorithms optimization-methods adamax amsgrad batch-gradient-descent stochastic-gradient-descent stochastic-optimization stochastic-optimizers momentum nadam nesterov-accelerated-sgd nesterov-momentum rmsprop
Language:Python 23
angetato / Optimizers-for-Tensorflow
Adam, NAdam and AAdam optimizers
optimizer tensorflow adam aadam-optimizers neural-nets deeplearning
Language:Python 22
lonePatient / NovoGrad-pytorch
pytorch implement of NovoGrad Optimizer
pytorch optimizer novograd cifar10 alexnet adam adamw
Language:Python 18
pre-eth / adam
ADAM is an actively developed CSPRNG inspired by ISAAC64
csprng adam c cryptography isaac-64 pseudorandom random random-number-generators rng cryptographic-algorithms cryptography-tools make simd x86 arm64 armv8 avx2 avx512 cli
Language:C 17
hiroyuki-kasai / SimpleDeepNetToolbox
Simple MATLAB toolbox for deep learning network: Version 1.0.3
deep-learning deep-neural-networks convolutional-neural-networks convolutional-layers softmax-layer relu-layer forward-backward matlab stochastic-gradient-descent adam adagrad optimization machine-learning stochastic-optimization sgd sgd-optimizer sgd-momentum variance-reduction machine-learning-algorithms big-data
Language:MATLAB 16
mknbv / adashift
AdaShift optimizer implementation in PyTorch
optimization-algorithms pytroch deep-learning adam wgan
Language:Python 16
RConsortium / submissions-pilot3-adam
Development repo for pilot3 submission to FDA - ADaM
adam cdisc r sdtm tlfs tlgs
Language:XSLT 15
B612-Asteroid-Institute / adam_home
ADAM python client and notebooks
client adam python jupyter-notebooks
Language:Python 13
atgenomix / deepvariant-on-spark
DeepVariant-on-Spark is a germline short variant calling pipeline that runs Google DeepVariant on Apache Spark at scale.
spark adam genomics ngs sequencing deepvariant deep-neural-network bioinformatics dna
Language:Shell 12
echocat / adam
Addon which enhances all user profiles of confluence. It also adds an advanced people directory. The whole addon is configurable by means of an XML, can be localized, supports Velocity templates and supports view and edit restrictions.
confluence adam addon ldap directory echocat
Language:Java 11
nducthang / Optimization-DeepLearning-Vietnamese
The optimization methods in deep learning explained by Vietnamese such as gradient descent, momentum, NAG, AdaGrad, Adadelta, RMSProp, Adam, Adamax, Nadam, AMSGrad.
adam gradient-descent adamax amsgrad optimization-algorithms
Language:Jupyter Notebook 10
OptimalFoundation / awesome-optimizers
Literature survey of convex optimizers and optimisation methods for deep-learning; made especially for optimisation researchers with ❤️
adam adamw optimization-algorithms adamp eve radam shampoo awesome awesome-list
9
B612-Asteroid-Institute / astrodynamics
Orbit propagation, orbit determination, and analysis code
server adam
Language:Java 8
amirrezarajabi / Neural-Network-implementation-from-scratch
implementation of neural network from scratch only using numpy (Conv, Fc, Maxpool, optimizers and activation functions)
neural-network ann deep-learning implementation-from-scratch numpy adam adam-optimizer cnn convolution fully-connected-network gradient-descent maxpooling relu-activation sgd sigmoid-activation
Language:Python 6
tak27 / adam
This is an implementation of Adam: A Method for Stochastic Optimization.
adam stochastic-optimization stochastic-gradient-descent
Language:Python 5
tr7200 / Adam_to_SGD
Tensorflow-Keras callback implementing arXiv 1712.07628
sgd-optimizer adam callback learning-rate switches
Language:Python 5

adam

LiyuanLucasLiu / RAdam

Malinskiy / adam

Tony-Y / pytorch_warmup

5hirish / adam_qas

CyberZHG / keras-radam

GSORF / Visual-GPS-SLAM

FujiNetWIFI / fujinet-firmware

Nasdin / ReinforcementLearning-AtariGame

AnicetNgrt / jiro-nn

GLambard / AdamW_Keras

YanaiEliyahu / AdasOptimizer

bentrevett / a-tour-of-pytorch-optimizers

davda54 / ada-hessian

Mrpatekful / swats

nengwp / Lion-vs-Adam

polyfem / polysolve

shreyansh26 / ML-Optimizers-JAX

uclaml / Padam

zmyzheng / Neural-Networks-and-Deep-Learning

JRC1995 / DemonRangerOptimizer

harshraj11584 / Paper-Implementation-Overview-Gradient-Descent-Optimization-Sebastian-Ruder

angetato / Optimizers-for-Tensorflow

lonePatient / NovoGrad-pytorch

pre-eth / adam

hiroyuki-kasai / SimpleDeepNetToolbox

mknbv / adashift

RConsortium / submissions-pilot3-adam

B612-Asteroid-Institute / adam_home

atgenomix / deepvariant-on-spark

echocat / adam

nducthang / Optimization-DeepLearning-Vietnamese

OptimalFoundation / awesome-optimizers

B612-Asteroid-Institute / astrodynamics

amirrezarajabi / Neural-Network-implementation-from-scratch

tak27 / adam

tr7200 / Adam_to_SGD