learning-rate-scheduling

There are 3 repositories under learning-rate-scheduling topic.

Tony-Y / pytorch_warmup
Learning Rate Warmup in PyTorch
adam deep-learning learning-rate-scheduling pytorch warmup
Language:Python 366
awslabs / adatune
Gradient based Hyperparameter Tuning library in PyTorch
deep-learning pytorch automl hyperparameter-tuning learning-rate-scheduling machine-learning neural-networks
Language:Python 289
kozistr / pytorch_optimizer
optimizer & lr scheduler & loss function collections in PyTorch
optimizer pytorch ranger chebyshev adamp radam madgrad adabound adabelief sam lookahead deep-learning diffgrad adamd nero adan gradient-centralization adai learning-rate-scheduling loss-functions
Language:Python 193
cmpark0126 / pytorch-polynomial-lr-decay
Polynomial Learning Rate Decay Scheduler for PyTorch
deep-learning learning-rate-decay learning-rate-scheduling pytorch pytorch-extension
Language:Python 65
Lance0218 / Pytorch-DistributedDataParallel-Training-Tricks
A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.
pytorch pytorch-distributeddataparallel distributed apex warmup learning-rate-scheduling early-stopping random-seeds
Language:Python 57
abhuse / cyclic-cosine-decay
Pytorch cyclic cosine decay learning rate scheduler
pytorch learning-rate-decay learning-rate-scheduling
Language:Jupyter Notebook 45
YuchenJin / autolrs
Automatic learning-rate scheduler
learning-rate-scheduling deep-learning machine-learning hyperparameter-tuning automl
Language:Python 42
lehduong / torch-warmup-lr
Warmup learning rate wrapper for Pytorch Scheduler
pytorch learning-rate-scheduling learning-rate-warmup deep-learning
Language:Python 39
git-disl / LRBench
A learning rate recommending and benchmarking tool.
deep-learning learning-rate-benchmarking learning-rate-scheduling
Language:Python 19
ahundt / sharpDARTS
sharpDARTS: Faster and More Accurate Differentiable Architecture Search
architecture-search cifar10 computer-vision cosine-annealing cosine-power-annealing deep-learning differentiable-hyperparamter-search hyperparameter-optimization hyperparameter-search hyperparameter-tuning imagenet learning-rate learning-rate-scheduling nas neural-architecture-search neural-networks power-cosine-annealing pytorch sota state-of-the-art
Language:Python 16
JonnoFTW / keras_find_lr_on_plateau
Keras Callback to Automatically Adjust the learning rate when it stops improving
keras learning-rate-scheduling
Language:Python 14
timesler / lr-momentum-scheduler
Pytorch implementation of arbitrary learning rate and momentum schedules, including the One Cycle Policy
onecyclepolicy pytorch deep-learning learning-rate-scheduling learning-rate learning-rate-finder
Language:Python 12
developer0hye / Learning-Rate-WarmUp
learning-rate-scheduling learning-rate-decay learning-rate-warmup
11
Lightweight-Transformer
TheQuantScientist / Lightweight-Transformer
A lightweight but efficient Transformer model for accurate univariate stock price forecasting, designed for real-time trading applications. This project transforms the vanilla Transformer architecture for higher-precision financial time series analysis with minimal computational demands.
learning-rate-scheduling dynamic-masking stock-prices-prediction lightweight-transformer
Language:Jupyter Notebook 10
cybertronai / pytorch-fd
Implementation of fluctuation dissipation relations for automatic learning rate annealing.
pytorch learning-rate-scheduling
Language:Python 8
ZIB-IOL / BIMP
Code to reproduce the experiments of ICLR2023-paper: How I Learned to Stop Worrying and Love Retraining
deep-learning learning-rate-scheduling neural-network optimization pruning pytorch sparsity
Language:Python 6
nomuramasahir0 / cma-learning-rate-adaptation
(GECCO2023 Best Paper Nomination) CMA-ES with Learning Rate Adaptation
black-box-optimization cma-es evolution-strategies evolution-strategy evolutionary-algorithms learning-rate-scheduling
Language:Python 3
sdamadi / image-classification
Comprehensive image classification for training multilayer perceptron (MLP), LeNet, LeNet5, conv2, conv4, conv6, VGG11, VGG13, VGG16, VGG19 with batch normalization, ResNet18, ResNet34, ResNet50, MobilNetV2 on MNIST, CIFAR10, CIFAR100, and ImageNet1K.
image-classification pytorch-implementation pytorch tensorboard tensorboard-pytorch logging resnet vgg small-convolutional mnist cifar imagenet hyperparameters sgd adam automatic-mixed-precision distributed-training learning-rate-scheduling learning-rate-warmup training
Language:Python 3
tourdeml / abel-pytorch
ABEL implemented in PyTorch
pytorch learning-rate-scheduling
Language:Python 3
iSiddharth20 / DeepLearning-ImageClassification-Toolkit
End-to-end Image Classification using Deep Learning toolkit for custom image datasets. Features include Pre-Processing, Training with Multiple CNN Architectures and Statistical Inference Tools. Special utilities for RAM optimization, Learning Rate Scheduling, and Detailed Code Comments are included.
collaborate convolutional-neural-networks cosine-annealing deep-learning efficientnet gradient-descent hacktoberfest image-classification image-processing inception-resnet-v2 learn learning-rate-scheduling opencv preprocessing resnet-50 statistical-analysis statistical-inference tensorflow vgg16
Language:Jupyter Notebook 2
kardasbart / MultiLR
A method for assigning separate learning rate schedulers to different parameters group in a model.
learning-rate learning-rate-scheduling pytorch scheduler torch deep-learning optimizer lr-scheduling lr
Language:Python 2
agiopouloskaptsikas / Dogs-vs-Cats-An-Image-Classification-Task-using-TensorFlow
In this repository, I put into test my newly acquired Deep Learning skills in order to solve the Kaggle's famous Image Classification Problem, called "Dogs vs. Cats".
dogs-vs-cats deep-learning python keras-tensorflow convolutional-neural-networks binary-image-classification data-augmentation transfer-learning dropout callbacks early-stopping learning-rate-scheduling
Language:Python 1
nam157 / learning-rate-schedule-pytorch
learning-rate-scheduling
Language:Jupyter Notebook 1
ndtands / CNN_Color_Car_Pytorch
Build from scratch
car-colors earlystopping image-classification learning-rate-scheduling mobilenetv2 resnet-18
Language:Jupyter Notebook 1
rharish101 / multistage-step-size-scheduling-minimax
Master's thesis: Experiments on multistage step size schedulers for first-order optimization in minimax problems
gans learning-rate-scheduling minimax-optimization multistage-stochastic-optimization thesis
Language:Python 1
synml / lr-scheduler-visualization
Visualize the progress of the learning rate scheduler graphically.
learning-rate-scheduling pytorch visualization
Language:Python 1
C-opt / 1st-Order-Optimizers-in-MATLAB
Code in MATLAB for 1st order optimization algorithms implemented for elastic net regularized convex objective functions.
1st-order-optimizers matlab stochastic-gradient-descent machine-learning-algorithms optimization-algorithms dasvrda learning-rate-scheduling
Language:MATLAB 0
draktr / optschedule
Flexible parameter scheduler that can be implemented with proprietary and open source optimizers.
artificial-intelligence decay gradient-descent learning-rate-scheduling machine-learning numerical-analysis numerical-methods optimization python scheduler scheduling
Language:Python 0
elaaj / cat-vs-dog-classifier
The goal of this project is to devise an accurate CNN-based classifier able to distinguish between Cat and Dog in images where the animal is predominant.
adamw-optimizer convolutional-neural-networks custom-training deep-learning learning-rate-scheduling pretrained-weights pytorch vgg11
Language:Jupyter Notebook 0
izdihartinoni / Image-Classification-Rock-Paper-Scissors-with-Model-Deployment
Submission Akhir - Image Classification Model Deployment - Belajar Pengembangan Machine Learning - Dicoding
deployment cnn learning-rate-scheduling tflite-models
Language:Jupyter Notebook 0
kbmclaren / assn5-CMSC478-ML
The machine learning task in this assignment is image classification using Convolutional Neural Networks in Tensorflow and Keras
baseline-cnns batch-normalization cifar-10 data-augmentation image-classification initialization keras learning-rate-scheduling machine-learning regularization tensorflow2 transfer-learning
Language:Jupyter Notebook 0
KhoiDOO / tvlars
TVLARS - A Fast Convergence Optimizer for Large Batch Training
large-batch-optimization layer-wise-relevance-propagation learning-rate learning-rate-scheduling optimization optimization-algorithms warmup
Language:Python 0
metalmerge / SPECTRA
SPECTRA: Solar Panel Evaluation through Computer Vision and Advanced Techniques for Reliable Analysis
data-augmentation image-classification neural-network pytorch solar-panels yolov8 deep-learning early-stopping hyperparameter-tuning learning-rate-scheduling machine-learning python resnet-50
Language:Python 0
rharish101 / label-noise-and-generalization
Semester project on the impact of label noise on deep learning optimization
deep-learning deep-learning-optimizers label-noise-robustness learning-rate-scheduling
Language:Python 0
xiangyutang2 / tweet-classification
bert glove-embeddings classification tweet disaster-assist bilstm lstm patience learning-rate-scheduling learning-rate-decay pytorch pytorch-implementation bert-pytorch
Language:HTML 0

learning-rate-scheduling

Tony-Y / pytorch_warmup

awslabs / adatune

kozistr / pytorch_optimizer

cmpark0126 / pytorch-polynomial-lr-decay

Lance0218 / Pytorch-DistributedDataParallel-Training-Tricks

abhuse / cyclic-cosine-decay

YuchenJin / autolrs

lehduong / torch-warmup-lr

git-disl / LRBench

ahundt / sharpDARTS

JonnoFTW / keras_find_lr_on_plateau

timesler / lr-momentum-scheduler

developer0hye / Learning-Rate-WarmUp

TheQuantScientist / Lightweight-Transformer

cybertronai / pytorch-fd

ZIB-IOL / BIMP

nomuramasahir0 / cma-learning-rate-adaptation

sdamadi / image-classification

tourdeml / abel-pytorch

iSiddharth20 / DeepLearning-ImageClassification-Toolkit

kardasbart / MultiLR

agiopouloskaptsikas / Dogs-vs-Cats-An-Image-Classification-Task-using-TensorFlow

nam157 / learning-rate-schedule-pytorch

ndtands / CNN_Color_Car_Pytorch

rharish101 / multistage-step-size-scheduling-minimax

synml / lr-scheduler-visualization

C-opt / 1st-Order-Optimizers-in-MATLAB

draktr / optschedule

elaaj / cat-vs-dog-classifier

izdihartinoni / Image-Classification-Rock-Paper-Scissors-with-Model-Deployment

kbmclaren / assn5-CMSC478-ML

KhoiDOO / tvlars

metalmerge / SPECTRA

rharish101 / label-noise-and-generalization

xiangyutang2 / tweet-classification