hessian-free

There are 0 repository under hessian-free topic.

amirgholami / PyHessian
PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks
hessian second-order second-order-optimization hessian-free pytorch-library
Language:Jupyter Notebook 756
amirgholami / adahessian
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
second-order-optimization hessian hessian-free optimizer adahessian
Language:Python 279
fmeirinhos / pytorch-hessianfree
PyTorch implementation of Hessian Free optimisation
pytorch optimizer hessian-free conjugate-gradient
Language:Python 43
ltatzel / PyTorchHessianFree
PyTorch implementation of the Hessian-free optimizer
conjugate-gradient deep-learning deep-neural-networks ggn hessian-free matrix-free newtons-method second-order-optimization pytorch-implementation optimization-algorithms stochastic-optimizers
Language:Python 36
Tismoney / HessianFree
On the New method of Hessian-free second-order optimization
neural-networks hessian-free curveball optimizer pytorch skoltech-course
Language:Jupyter Notebook 8
yorkerlin / StructuredNGD-DL
Matrix-multiplication-only KFAC; Code for ICML 2023 paper on Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning
kfac natural-gradients optimization-methods optimizer pytorch-implementation second-order-optimization fisher deep-learning hessian-free
Language:Python 4
cor3bit / somax
Stochastic Second-Order Methods in JAX
jax machine-learning second-order-optimization gauss-newton-method hessian-free natural-gradient quasi-newton stochastic-optimization
Language:Python 3
onopkosonja / OptimizationMethods
Implementation of numerical optimization algorithms for logistic regression problem.
optimization optimization-algorithms gradient-descent newton hessian-free bfgs lbfgs adam linesearch stochastic-gradient-descent logistic-regression python
Language:Python 3
ozzzp / MLHF
Tensorflow implement of Meta Learning with Hessian Free Approach in Deep Neural Nets Training
meta-learning hessian-free
Language:Python 1
rharish101 / CS771-Project
Course project for CS771A: Introduction to Machine Learning
tensorflow optimization hessian-free python3
Language:Python 1
shizheng-rlfresh / llm-opt
Fine-tuning LLMs with LoRA and Hessian-free optimizers
deep-learning hessian-free large-language-models optimizer
Language:Python 1
mtkwT / adaptive-hessian-free-optimization
Implementation of Adaptive Hessian-free optimization.
neural-network tensorflow optimizer adaptive-learning hessian-free
Language:Python 0
adele-k02 / large-scale-numerical-optimization
optimization-methods tensorflow hessian-free python matlab conjugate-gradient sparse-matrix-methods
Language:TeX