sharpness-aware-minimization

There are 0 repository under sharpness-aware-minimization topic.

val-iisc / SDAT
[ICML 2022]Source code for "A Closer Look at Smoothness in Domain Adversarial Training",
adversarial-training dann domain-adaptation icml-2022 pytorch sharpness-aware-minimization
Language:Python 68
understanding-sam
tml-epfl / understanding-sam
Towards Understanding Sharpness-Aware Minimization [ICML 2022]
flatness generalization sharpness sharpness-aware-minimization understanding-deep-learning
Language:Jupyter Notebook 34
sanketvmehta / lifelong-learning-pretraining-and-sam
Code for the paper "Mehta, S. V., Patil, D., Chandar, S., & Strubell, E. (2023). An Empirical Investigation of the Role of Pre-training in Lifelong Learning. The Journal of Machine Learning Research 24 (2023)"
continual-learning lifelong-learning pre-training sharpness-aware-minimization flat-minima
Language:Python 16
wangermeng2021 / FastClassification
FastClassification is a tensorflow toolbox for class classification. It provides a training module with various backbones and training tricks towards state-of-the-art class classification.
autoaugment cutmix image-classification lr-finder mixup progressive-resizing randaugment sam sharpness-aware-minimization tensorflow2
Language:Python 16
CGCL-codes / TransferAttackSurrogates
The official code of IEEE S&P 2024 paper "Why Does Little Robustness Help? A Further Step Towards Understanding Adversarial Transferability". We study how to train surrogates model for boosting transfer attack.
adversarial-attacks adversarial-training black-box-attack data-augmentation distribution-shift gradient-regularization sharpness-aware-minimization transfer-attack
Language:Python 12
TrustAIoT / CR-SAM
Code for AAAI 2024 paper: CR-SAM: Curvature Regularized Sharpness-Aware Minimization
deep-neural-networks optimization sharpness-aware-minimization
Language:Python 8
Lee-Gihun / FedSOL
(CVPR 2024) Official Implementation of "FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning"
computer-vision continual-learning deep-learning distributed-learning fedavg fednova fedntd fedprox machine-learning moon scaffold fedsol federated-learning federated-learning-framework optimization sharpness-aware-minimization fedsam knnper perfedavg
Language:Python 6
sanderson4030 / SharpnessAwareMinimization
Sharpness Aware Minimization for Fastai
deep-learning fastai fastai-extensions deep-learning-papers sharpness-aware-minimization
Language:Python 4
EnnengYang / DFGP
Data Augmented Flatness-aware Gradient Projection for Continual Learning. ICCV, 2023.
catastrophic-forgetting continual-learning data-augmentation gradient-projection orthogonal-projection sharpness-aware-minimization subspace-learning
Language:Python 3
cerebrai / pgn_sam.pytorch
PyTorch implementation of Penalizing Gradient Norm for Efficiently Improving Generalization in Deep Learning
deep-learning machine-learning optimization penalizing-gradient-norm pytorch pytorch-implementation sharpness-aware-minimization
Language:Python 0
gjlee0802 / LeNet-5
LeNet-5 with SAM, Generalization
generalization generalization-ability generalization-of-deep-cnn lenet-5 mnist sharpness-aware-minimization
Language:Jupyter Notebook 0
vinnik-dmitry07 / full-batch
Super-Convergence on CIFAR10
adamw large-batch-optimization lion lion-optimizer madgrad second-order-optimization sharpness-aware-minimization sophia super-convergence weight-decay cifar10
Language:Python