Omead Pooladzandi's repositories
Preconditioned-Stochastic-Gradient-Descent
A repo based on XiLin Li's PSGD repo that extends some of the experiments.
Survey-of-Second-Order-Optimizers
Term Project for ECE 236c focused on 2nd order optimization
ece_210_final_project
Final Project for ECE 210 - Learning
adahessian
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
Language:PythonMIT000
Language:C++000
dadaptation
D-Adaptation for SMD and Regret Based Methods
Language:PythonMIT000
psgd_torch
Pytorch implementation of preconditioned stochastic gradient descent
Language:Python000
signal_subspace
vector and ensemble signal analysis w/ subspace methods such as Esprit and RootMusic
kanmlps-psgd
KANs and MLPs -- consider how second order optimizers affect KANs and MLPs
Language:PythonGPL-3.0000
prodigy
The Prodigy optimizer and its variants for training neural networks.
Language:PythonMIT000