f-dangel / backpack

BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.

https://backpack.pt/

f-dangel/backpack Issues

KFAC support in BatchNorm (eval mode)
Updated a month ago16
AttributeError: 'Parameter' object has no attribute 'grad_batch'
Updated 2 months ago9
Request: Extension for GroupNorm
Updated 2 months ago1
Feature request: `BatchL2Grad` for `LayerNorm`
Updated 2 months ago
BackPACK with simple attention and additional layers
Updated 3 months ago1
Are customized loss functions supported?
Closed 4 months ago10
Second Order Extensions for Custom Loss Modules
Closed 4 months ago8
Extend backpack to deal with weighted sums
Updated 5 months ago14
Missing Support for BatchNorm and AdaptiveAvgPool in HBP methods (KFAC, KFRA, KFLR) and GGNMP
Updated 5 months ago8
Support nn.GaussianNLLLoss
Updated 8 months ago3
Feature for backpack on VAEs
Updated 9 months ago2
Facing error while Using DiagHessian for torchvision.models.resnet18
Closed 10 months ago1
Missing implementation of supported layers for DiagHessian and BatchDiagHessian
Updated a year ago
AdaptiveAvgPool not supported for 2nd order derivatives?
Closed a year ago4
add support for torch 2.0?
Closed a year ago7
torch version < 2.x in `setup.cfg`
Closed a year ago2
Container modules with advanced control flow & modules with multiple inputs
Updated a year ago23
Second order extension
Closed a year ago2
Encountered node that may break second-order extensions
Closed a year ago2
Optimizing the locations of the Jacobians
Updated a year ago5
Website example not working.
Closed 2 years ago2
cannot import backpack nor extend
Closed 2 years ago9
pytorch 1.13 support
Closed 2 years ago2
[Feature Request] Levenberg Marquardt
Updated 2 years ago1
Extending `BCEWithLogitsLoss` to non-binary labels
Updated 2 years ago
Support for Custom models?
Updated 2 years ago1
Support for LayerNorm
Updated 2 years ago3
Gradient of tensor output
Closed 2 years ago6
Error when using the laplace package, a backpack module is raising issues
Closed 2 years ago6
Update examples on website
Closed 2 years ago1
memory leakage problem when loss.backward()
Updated 2 years ago14
Second order computations for nn.Upsample
Updated 2 years ago1
AttributeError: 'BatchNorm2d' object has no attribute 'output'
Updated 2 years ago4
Does Backpack Support Reusing Layers (First Order Extensions)
Closed 2 years ago4
Hutchinson trace example does not work on ResNet18
Closed 2 years ago3
Parameter `grad`s don't get initialized with `BatchL2Grad` and BatchNorm
Updated 2 years ago7
OOM eventually when using create_graph=True with BatchL2Grad
Updated 3 years ago2
v1.4.0 no longer seems to support `backward()` with the `inputs` parameter referencing a sub-module's parameters
Closed 3 years ago14
[feature request] KFAC support for ResNet
Closed 3 years ago5
Extend part of the model
Updated 3 years ago1
can not import backpack (ImportError: cannot import name 'OrderedDict' from 'typing')
Closed 3 years ago2
AdaptiveAvgPool3d: wait for bug resolved -> delete warning
Updated 3 years ago2
Computing gradients of a batch of M-dimensional tensors
Closed 3 years ago7
[Not working] Individual Hessian-vector products with `BatchGrad`
Closed 3 years ago10
Batch norm individual gradients
Closed 3 years ago2
`reduction`-dependent scaling factor of `grad_batch`
Closed 3 years ago3
How to support first-order extensions for custom modules?
Closed 3 years ago17
[not confirmed] `AttributeError` related to BackPACK's IO
Closed 3 years ago12
Group conv
Closed 3 years ago6
torch.autograd.grad support
Closed 3 years ago4