learning-rate

There are 2 repositories under learning-rate topic.

davidtvs / pytorch-lr-finder
A learning rate range test implementation in PyTorch
learning-rate pytorch
Language:Python 881
BIGBALLON / cifar-10-cnn
Play deep learning with CIFAR datasets
deep-learning cifar10 tensorflow keras convolutional-neural-networks cifar-100 residual-networks densenet learning-rate
Language:Python 812
j-w-yun / optimizer-visualization
Visualize Tensorflow's optimizers.
tensorflow machine-learning optimization-algorithms learning-rate optimizer-visualization adamoptimizer gradientdescentoptimizer
Language:Python 351
goessl / MachineLearning
An easy neural network for Java!
java machine-learning neural-network neurons hidden-layers weight learning-rate artificial-intelligence weights learning matrix matrices matrix-calculations prediction easy-to-use lightweight begginer
Language:Java 126
wassname / viz_torch_optim
Videos of deep learning optimizers moving on 3D problem-landscapes
optimization-algorithms vizualisation 3d-graphics pytorch machine-learning deep-learning optimizer learning-rate
Language:Jupyter Notebook 104
richardwth / MMD-GAN
Improving MMD-GAN training with repulsive loss function
generative-adversarial-network maximum-mean-discrepancy loss-functions deep-learning dcgan mmd mmd-gan learning-rate mmd-losses discriminator tensorflow gan generative-model
Language:Python 84
sooftware / pytorch-lr-scheduler
PyTorch implementation of some learning rate schedulers for deep learning researcher.
learning-rate scheduler warmup transformer reduce lr plateau tri-stage
Language:Python 84
fir1
berndporr / fir1
FIR & LMS filter implementation in C++ with Python & JAVA wrappers
signal-processing filter c-plus-plus fir library lms least-squares leastsquares digital-signal-processing cmake learning-rate coefficients java jni-android jni-wrapper jni-java python-library python3 python-extension
Language:C 71
mhmoodlan / cyclic-learning-rate
Cyclic learning rate TensorFlow implementation.
tensorflow cyclic-learning-rate learning-rate-decay learning-rate eager-execution
Language:Python 66
dkumazaw / onecyclelr
One cycle policy learning rate scheduler in PyTorch
learning-rate pytorch one-cycle-policy
Language:Python 47
CyberZHG / keras-lr-multiplier
Learning rate multiplier
optimizer keras learning-rate
Language:Python 46
eBay / AutoOpt
Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient Descent
machine-learning optimization pytorch sgd learning-rate momentum hyperparameters
Language:Python 44
JGuillaumin / swa-tf
Stochastic Weight Averaging - TensorFlow implementation
learning-rate ema averages-weights swa tensorflow stochastic-weight-averaging
Language:Python 32
ahirsharan / MTL-Segmentation
Meta Transfer Learning for Few Shot Semantic Segmentation using U-Net
pytorch mtl segmentation fewshot-learning fewshot coco semantic-segmentation python mtl-segmentation meta-transfer-learning unet unet-image-segmentation unet-pytorch shot-learning dice-loss meta-train learning-rate hyperparameters
Language:Python 21
Octavian-ai / learning-rates
How optimizer and learning rate choice affects training performance
ai learning-rate deep-learning hyperparameters optimizer
Language:Python 21
meet-minimalist / TinyImageNet-Benchmarks
Benchmarking various Computer Vision models on TinyImageNet Dataset
tinyimagenet benchmark tensorflow python implementation deep-learning paper paper-implementations learning-rate classifier cyclic-learning-rates vgg16 resnet inception xception mobilenet squeezenet nasnet mnasnet efficientnet
Language:Python 17
ahundt / sharpDARTS
sharpDARTS: Faster and More Accurate Differentiable Architecture Search
architecture-search cifar10 computer-vision cosine-annealing cosine-power-annealing deep-learning differentiable-hyperparamter-search hyperparameter-optimization hyperparameter-search hyperparameter-tuning imagenet learning-rate learning-rate-scheduling nas neural-architecture-search neural-networks power-cosine-annealing pytorch sota state-of-the-art
Language:Python 16
harshalmittal4 / Hypergradient_variants
Improved Hypergradient optimizers, providing better generalization and faster convergence.
hypergradient optimizers learning-rate step-size adam-optimizer momentum
Language:Jupyter Notebook 16
benihime91 / one_cycle_lr-tensorflow
OneCycle LearningRateScheduler & Learning Rate Finder for TensorFlow 2.
tensorflow2 deeplearning python3 learning-rate keras one-cycle-policy lr-finder tensorflow
Language:Jupyter Notebook 15
Octavian-ai / learning-rate-finder-tensorflow
Implementation of learning rate finder in TensorFlow
lr-finder learning-rate exponential-decay exponential octavian-ai tensorflow
Language:Python 12
timesler / lr-momentum-scheduler
Pytorch implementation of arbitrary learning rate and momentum schedules, including the One Cycle Policy
onecyclepolicy pytorch deep-learning learning-rate-scheduling learning-rate learning-rate-finder
Language:Python 12
EPSOFT / callbacks
callbacks in ai
callbacks python twint learning-rate
Language:Jupyter Notebook 11
LEFTeyex / warmup
A Warmup Scheduler for Pytorch to achieve the warmup learning rate at the beginning of training.
learning-rate pytorch warmup
Language:Python 9
coxy1989 / superconv
TensorFlow/Keras implementation of the paper: 'Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates'
tensorflow super-convergence leslie smith keras deep-learning learning-rate
Language:Jupyter Notebook 8
BIGBALLON / ResNet_CIFAR
Residual Network Experiments with CIFAR Datasets.
cifar-10 cifar-100 keras resnet learning-rate tensorflow
Language:Python 6
Mr-TalhaIlyas / Learning-Rate-Schedulers-Packege-Tensorflow-PyTorch-Keras
A packages containing all popular Learning Rate Schedulers. Implemented in Keras Tensorflow
cosine-decay learning-rate sgdr step-decay schedule polynomial-decay k-decay exponential-decay sgdr-decay sgdr-warmup keras tensorflow
6
pcluteijn / MazeLearning
Q-Learing algorithm solves simple mazes.
q-learning matlab reinforcement-learning-algorithms maze maze-generator maze-solver agent step-size learning-rate discount-rate sutton barto reinforcedlearning reinforcement-learning-analysis reinforcement-learning-agent prims-algorithm artificial-intelligence discrete-mathematics
Language:MATLAB 6
sungsujaing / Happy_Dog_Detection
Detect happy dogs in real-time
dataset-generation augmentation keras-tensorflow learning-rate
Language:Jupyter Notebook 6
connorcl / pytorch-lr-explorer
A Jupyter notebook exploring sophisticated learning rate strategies for training deep neural networks
python3 pytorch deep-learning cnn learning-rate jupyter-notebook pytorch-image-classifier
Language:Jupyter Notebook 5
tr7200 / Adam_to_SGD
Tensorflow-Keras callback implementing arXiv 1712.07628
sgd-optimizer adam callback learning-rate switches
Language:Python 5
coxy1989 / clr
Pytorch implementation of the paper: 'Cyclical Learning Rates for Training Neural Networks'
pytorch cyclical-learning-rates clr leslie smith reproduction deep-learning learning-rate
Language:Jupyter Notebook 3
fitushar / Cyclical-Learning-Rates-for-Training-Neural-Networks-With-Unbalanced-Data-Sets
As the learning rate is one of the most important hyper-parameters to tune for training convolutional neural networks. In this paper, a powerful technique to select a range of learning rates for a neural network that named cyclical learning rate was implemented with two different skewness degrees. It is an approach to adjust where the value is cycled between a lower bound and upper bound. CLR policies are computationally simpler and can avoid the computational expense of fine tuning with fixed learning rate. It is clearly shown that changing the learning rate during the training phase provides by far better results than fixed values with similar or even smaller number of epochs.
learning-rates neural-network clr clr-policies expense epochs range skewness-degrees cnn cyclical-learning-rates learning-rate hyperparameters
Language:Jupyter Notebook 3
lorenzwalthert / KerasMisc
Add-on functionality for the R implementation of Keras
keras callback learning-rate
Language:R 3
NvsYashwanth / machinelearningmaster
All about machine learning
gradient-descent learning-rate regression linear-regression logistic-regression machine-learning scikit-learn matplotlib numpy documentation tutorial explanation regularization-methods polynomial-regression learning-curves batch-gradient-descent mini-batch-gradient-descent stochastic-gradient-descent ridge-regression lasso-regression
Language:Jupyter Notebook 3
shishishi123 / CS5824-final-project
Reproduction of the "Don't Decay the Learning Rate, Increase the Batch Size" conference paper.
batch-size learning-rate pytorch gpu-computing
Language:Python 3
RajK01 / Google-Customer-Revenue-Prediction
The main aim of this project is to built a predictive model using G Store data to predict the TOTAL REVENUE per customer that helps in better use of marketing budget.
deep-learning exploratory-data-analysis keras-tensorflow machine-learning neural-network python epoch json learning-rate matplotlib relu-activation normalization dense dropout activation-functions sequencial sklearn
Language:Jupyter Notebook 2

learning-rate

davidtvs / pytorch-lr-finder

BIGBALLON / cifar-10-cnn

j-w-yun / optimizer-visualization

goessl / MachineLearning

wassname / viz_torch_optim

richardwth / MMD-GAN

sooftware / pytorch-lr-scheduler

berndporr / fir1

mhmoodlan / cyclic-learning-rate

dkumazaw / onecyclelr

CyberZHG / keras-lr-multiplier

eBay / AutoOpt

JGuillaumin / swa-tf

ahirsharan / MTL-Segmentation

Octavian-ai / learning-rates

meet-minimalist / TinyImageNet-Benchmarks

ahundt / sharpDARTS

harshalmittal4 / Hypergradient_variants

benihime91 / one_cycle_lr-tensorflow

Octavian-ai / learning-rate-finder-tensorflow

timesler / lr-momentum-scheduler

EPSOFT / callbacks

LEFTeyex / warmup

coxy1989 / superconv

BIGBALLON / ResNet_CIFAR

Mr-TalhaIlyas / Learning-Rate-Schedulers-Packege-Tensorflow-PyTorch-Keras

pcluteijn / MazeLearning

sungsujaing / Happy_Dog_Detection

connorcl / pytorch-lr-explorer

tr7200 / Adam_to_SGD

coxy1989 / clr

fitushar / Cyclical-Learning-Rates-for-Training-Neural-Networks-With-Unbalanced-Data-Sets

lorenzwalthert / KerasMisc

NvsYashwanth / machinelearningmaster

shishishi123 / CS5824-final-project

RajK01 / Google-Customer-Revenue-Prediction