Felix Dangel (f-dangel)

f-dangel

Geek Repo

Company:@ProbabilisticNumerics @VectorInstitute

Location:Toronto

Home Page:https://fdangel.com

Twitter:@f_dangel

Github PK Tool:Github PK Tool

Felix Dangel's repositories

backpack

BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.

Language:PythonLicense:MITStargazers:549Issues:6Issues:79

cockpit

Cockpit: A Practical Debugging Tool for Training Deep Neural Networks

Language:PythonLicense:MITStargazers:473Issues:11Issues:16

unfoldNd

(N=1,2,3)-dimensional unfold (im2col) and fold (col2im) in PyTorch

Language:PythonLicense:MITStargazers:82Issues:4Issues:19

phd-thesis

Source code for my PhD thesis: Backpropagation Beyond the Gradient

Language:TeXStargazers:20Issues:2Issues:0

hbp

Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations

Language:PythonLicense:MITStargazers:19Issues:3Issues:0

singd

[ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)

vivit

[TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivatives & Newton steps

Language:PythonLicense:MITStargazers:17Issues:2Issues:2

curvlinops

scipy linear operators for the Hessian, Fisher/GGN, and more in PyTorch

Language:PythonLicense:MITStargazers:15Issues:4Issues:35

einconv

Convolutions and more as einsum for PyTorch

Language:PythonLicense:MITStargazers:12Issues:3Issues:2

phd-thesis-template

LaTeX template for my PhD thesis at the University of Tuebingen

Language:TeXStargazers:8Issues:2Issues:0

sirfshampoo

[ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)

Language:PythonLicense:MITStargazers:8Issues:3Issues:8

backobs

Use DeepOBS with BackPACK

Language:PythonLicense:MITStargazers:2Issues:3Issues:3

org-export-setup

My org-export settings

Language:TeXStargazers:2Issues:2Issues:0

python-utilities

Python utility functions I often use

Language:PythonLicense:MITStargazers:2Issues:2Issues:0

cockpit-experiments

Experiments for the NeurIPS 2021 paper "Cockpit: A Practical Debugging Tool for the Training of Deep Neural Networks"

Language:PythonLicense:MITStargazers:1Issues:1Issues:0

DeepOBS

DeepOBS: A Deep Learning Optimizer Benchmark Suite

Language:PythonLicense:MITStargazers:1Issues:1Issues:1

org-html-themes

How to export Org mode files into awesome HTML in 2 minutes

Language:CSSLicense:GPL-3.0Stargazers:1Issues:1Issues:0

vivit-experiments

Experiments for the TMLR 2023 paper "ViViT: Curvature Access Through the Generalized Gauss-Newton’s Low-rank Structure"

Language:PythonLicense:MITStargazers:1Issues:2Issues:1

backpack-experiments

Experiments code for "BackPACK: Packing more into Backrop" [ICLR 2020]

Language:PythonStargazers:0Issues:1Issues:0

bibliography-file

My global `.bib` file to store bibliographic records

Language:TeXStargazers:0Issues:2Issues:0

PyHessian

PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks

Language:Jupyter NotebookLicense:MITStargazers:0Issues:1Issues:0

PyTorchHessianFree

PyTorch implementation of the Hessian-free optimizer

License:BSD-3-ClauseStargazers:0Issues:0Issues:0

StructuredNGD-DL

Matrix-multiplication-only KFAC; Code for ICML 2023 paper on Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning

Language:PythonStargazers:0Issues:1Issues:0