Felix Dangel's repositories
phd-thesis
Source code for my PhD thesis: Backpropagation Beyond the Gradient
curvlinops
scipy linear operators for the Hessian, Fisher/GGN, and more in PyTorch
sirfshampoo
[ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
phd-thesis-template
LaTeX template for my PhD thesis at the University of Tuebingen
org-export-setup
My org-export settings
python-utilities
Python utility functions I often use
cockpit-experiments
Experiments for the NeurIPS 2021 paper "Cockpit: A Practical Debugging Tool for the Training of Deep Neural Networks"
org-html-themes
How to export Org mode files into awesome HTML in 2 minutes
vivit-experiments
Experiments for the TMLR 2023 paper "ViViT: Curvature Access Through the Generalized Gauss-Newton’s Low-rank Structure"
wandb_preempt
Code and tutorial on integrating wandb sweeps with Slurm pre-emption
backpack-experiments
Experiments code for "BackPACK: Packing more into Backrop" [ICLR 2020]
bibliography-file
My global `.bib` file to store bibliographic records
PyTorchHessianFree
PyTorch implementation of the Hessian-free optimizer
StructuredNGD-DL
Matrix-multiplication-only KFAC; Code for ICML 2023 paper on Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning