sgd

There are 1 repository under sgd topic.

salesforce / awd-lstm-lm
LSTM and QRNN Language Model Toolkit for PyTorch
lstm pytorch language-model sgd qrnn
Language:Python 1955
vballoli / nfnets-pytorch
NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/
pytorch image-classification deepmind adaptive-gradient-clipping nfnets sota paper sgd
Language:Python 340
tsycnh / mlbasic
深度学习常用优化方法详解
minibatch-sgd gradient-descent sgd momentum
Language:Python 269
yechengxi / LightNet
Efficient, transparent deep learning in hundreds of lines of code.
deep-learning neural-network cnn matlab cudnn mlp rnn sgd quasi-recurrent-neural-networks lstm
Language:MATLAB 267
hiroyuki-kasai / SGDLibrary
MATLAB/Octave library for stochastic optimization algorithms: Version 1.0.20
optimization optimization-algorithms machine-learning machine-learning-algorithms stochastic-optimization-algorithms stochastic-gradient-descent big-data gradient-descent-algorithm gradient logistic-regression sgd variance-reduction newtons-method linear-regression classification online-learning quasi-newton svrg softmax-classification matlab
Language:MATLAB 206
wenwei202 / terngrad
Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)
distributed-training sgd quantization deep-learning deep-neural-networks data-parallelism
Language:Python 181
gyrdym / ml_algo
Machine learning algorithms in Dart programming language
dartlang dart machine-learning linear-regression sgd stochastic-gradient-descent batch-gradient-descent mini-batch-gradient-descent machine-learning-algorithms algorithm lasso-regression logistic-regression softmax softmax-regression softmax-classifier softmax-algorithm regression hyperparameters data-science classifier
Language:Dart 176
SirRob1997 / Crowded-Valley---Results
This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
deep-learning deep-learning-optimizers deep-neural-networks deeplearning sgd adam-optimizer
173
OverLordGoldDragon / keras-adamw
Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
keras optimizers adamw adamwr nadam sgd learning-rate-multipliers warm-restarts tensorflow
Language:Python 167
jiro-nn
AnicetNgrt / jiro-nn
A Deep Learning and preprocessing framework in Rust with support for CPU and GPU.
adam classification dropout machine-learning ml nalgebra neural-networks nn pipelines regression rust sgd data-analysis cuda deep-learning gpu gpu-computing opencl
Language:Rust 118
ucla-vision / entropy-sgd
Lua implementation of Entropy-SGD
sgd deep-learning iclr pytorch entropy-sgd
Language:Python 78
bentrevett / a-tour-of-pytorch-optimizers
A tour of different optimization algorithms in PyTorch.
adadelta adagrad adam optimization optimization-algorithms pytorch pytorch-optimizers rmsprop sgd
Language:Jupyter Notebook 77
jack-willturner / batchnorm-pruning
Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layers https://arxiv.org/abs/1802.00124
sgd pruning deep-learning batchnorm lasso
Language:Python 70
ZebraDevs / LinkOS-Android-Samples
Java based sample code for developing on Android. The demos in this repository are stored on separate branches. To navigate to a demo, please click branches.
printer sgd printstation android java zebra
67
c-gabri / Federated-Learning-PyTorch
PyTorch implementation of Federated Learning algorithms FedSGD, FedAvg, FedAvgM, FedIR, FedVC, FedProx and standard SGD, applied to visual classification. Client distributions are synthesized with arbitrary non-identicalness and imbalance (Dirichlet priors). Client systems can be arbitrarily heterogeneous. Several mobile-friendly models are provided
federated-learning fedsgd fedavg fedavgm fedir fedvc fedprox non-iid imbalance heterogeneity classification pytorch sgd
Language:Python 61
hiroyuki-kasai / RSOpt
Riemannian stochastic optimization algorithms: Version 1.0.3
riemannian-optimization riemannian-manifold non-convex-optimization machine-learning-algorithms stochastic-optimization stochastic-gradient-descent stochastic-optimizers variance-reduction constrained-optimization nonlinear-optimization large-scale-learning big-data machine-learning nonlinear-optimization-algorithms manifold optimization-algorithms optimization sgd online-learning
Language:MATLAB 59
Mrpatekful / swats
Unofficial implementation of Switching from Adam to SGD optimization in PyTorch.
swats pytorch adam sgd optimizer
Language:Python 58
loudinthecloud / dpwa
Distributed Learning by Pair-Wise Averaging
deep-learning distributed-systems asynchronous-learning sgd pytorch gossiping python neural-networks
Language:Python 53
decile-team / jensen
A C++ toolkit for Convex Optimization (Logistic Loss, SVM, SVR, Least Squares etc.), Convex Optimization algorithms (LBFGS, TRON, SGD, AdsGrad, CG, Nesterov etc.) and Classifiers/Regressors (Logistic Regression, SVMs, Least Squares Regression etc.)
machine-learning machine-learning-algorithms convex-optimization lbfgs-algorithm sgd logistic-regression support-vector-machines gradient-descent optimization-algorithms jensen tron lbfgs regularization
Language:C++ 49
dselivanov / FTRL
R/Rcpp implementation of the 'Follow-the-Regularized-Leader' algorithm
logistic-regression sgd ftrl r machine-learning
Language:R 48
hwalsuklee / numpy-neuralnet-exercise
Implementation of key concepts of neuralnetwork via numpy
neural-network deeplearning numpy cross-entropy-loss sgd relu mnist numpy-neuralnet-exercise regularization dropout xavier-initializer cnn
Language:Python 48
eBay / AutoOpt
Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient Descent
machine-learning optimization pytorch sgd learning-rate momentum hyperparameters
Language:Python 44
chentingpc / NNCF
Code for paper "On Sampling Strategies for Neural Network-based Collaborative Filtering"
neural-networks collaborative-filtering recommender-system sgd deep-learning
Language:Python 39
haidfs / TransE
TransE方法的Python实现，解释SGD中TransE的向量更新
transe sgd multiprocessing
Language:Python 39
ucla-vision / parle
pytorch parle sgd distributed deep-learning cifar10 wide-residual-networks
Language:Python 38
arseniyturin / SGD-From-Scratch
Stochastic gradient descent from scratch for linear regression
gradient-descent sgd linear-regression derivatives
Language:Jupyter Notebook 33
thecml / dpsgd-optimizer
Amortized version of the differentially private SGD algorithm published in "Deep Learning with Differential Privacy" by Abadi et al. Enforces privacy by clipping and sanitising the gradients with Gaussian noise during training.
tensorflow gradient-descent differential-privacy python deep-learning privacy sgd mnist tensorflow2 research
Language:Python 33
xinyandai / gradient-quantization
vector quantization for stochastic gradient descent.
gradient-quantization gradient-compression sgd federated-learning distributed-machine-learning
Language:Python 33
tml-epfl / sgd-sparse-features
SGD with large step sizes learns sparse features [ICML 2023]
generalization implicit-bias sgd large-step-sizes
Language:Jupyter Notebook 31
Akramz / grokking-deep-learning-notebooks
Notes & Code to go over "Grokking Deep Learning" Book by Andrew Trask
machine-learning deep-learning artificial-intelligence neural-networks numpy numpy-tutorial rnn lstm federated-learning forward-propagation backpropagation sgd
Language:Jupyter Notebook 23
dpressel / sgdtk
A Java library for Stochastic Gradient Descent (SGD)
sgd crf logistic-regression svm java
Language:Java 20
LPD-EPFL / ByzantineMomentum
Distributed Momentum for Byzantine-resilient Stochastic Gradient Descent (ICLR 2021)
sgd pytorch momentum byzantine ml iclr
Language:Python 19
yym-ustc / FactorizationMachine
implementation of factorization machine, support classification.
machine-learning factorization-machine sgd adagrad
Language:C++ 19
dimgold / Artificial_Curiosity
Adaptive Reinforcement Learning of curious AI basketball agents
reinforcement-learning data-science artificial-intelligence neural-networks bayesian-inference bayesian-network svm-classifier random-forest feature-selection curiosity nba basketball adaptive-learning pandas seaborn genetic-algorithm information-gain simulation sgd one-hot-encode
Language:Jupyter Notebook 18
kirushyk / le
Machine Learning Framework
machine-learning deep-learning svm linear-regression sequential-minimal-optimization gradient-descent meson c11 python sgd regression polynomial-regression mnist computer-vision
Language:C 17
theedhum-nandrum
oligoglot / theedhum-nandrum
A sentiment classifier on mixed language (and mixed script) reviews in Tamil, Malayalam and English
mixed-language sentiment-classifier tamil malayalam classification sgd logistic-regression lstm
Language:Python 16

sgd

salesforce / awd-lstm-lm

vballoli / nfnets-pytorch

tsycnh / mlbasic

yechengxi / LightNet

hiroyuki-kasai / SGDLibrary

wenwei202 / terngrad

gyrdym / ml_algo

SirRob1997 / Crowded-Valley---Results

OverLordGoldDragon / keras-adamw

AnicetNgrt / jiro-nn

ucla-vision / entropy-sgd

bentrevett / a-tour-of-pytorch-optimizers

jack-willturner / batchnorm-pruning

ZebraDevs / LinkOS-Android-Samples

c-gabri / Federated-Learning-PyTorch

hiroyuki-kasai / RSOpt

Mrpatekful / swats

loudinthecloud / dpwa

decile-team / jensen

dselivanov / FTRL

hwalsuklee / numpy-neuralnet-exercise

eBay / AutoOpt

chentingpc / NNCF

haidfs / TransE

ucla-vision / parle

arseniyturin / SGD-From-Scratch

thecml / dpsgd-optimizer

xinyandai / gradient-quantization

tml-epfl / sgd-sparse-features

Akramz / grokking-deep-learning-notebooks

dpressel / sgdtk

LPD-EPFL / ByzantineMomentum

yym-ustc / FactorizationMachine

dimgold / Artificial_Curiosity

kirushyk / le

oligoglot / theedhum-nandrum