kfac

There are 0 repository under kfac topic.

ikostrikov / pytorch-a2c-ppo-acktr-gail
PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation (ACKTR) and Generative Adversarial Imitation Learning (GAIL).
a2c acktr actor-critic advantage-actor-critic ale atari continuous-control deep-learning deep-reinforcement-learning hessian kfac kronecker-factored-approximation mujoco natural-gradients ppo proximal-policy-optimization pytorch reinforcement-learning roboschool second-order
Language:Python 3532
tfjgeorge / nngeometry
{KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch
ntk neural-tangent-kernel fim fisher-information-matrix pytorch kfac ekfac jacobian k-fac ek-fac gram tangent
Language:Python 197
alecwangcq / KFAC-Pytorch
Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
kfac ekfac optimizer optimization pytorch
Language:Python 124
gpauloski / kfac-pytorch
Distributed K-FAC Preconditioner for PyTorch
pytorch optimizer kfac distributed second-order-optimization deep-learning
Language:Python 74
MaximeRobeyns / bayesian_lora
Bayesian Low-Rank Adaptation for Large Language Models
kfac laplace-approximation llm
Language:Python 17
f-dangel / einconv
Convolutions and more as einsum for PyTorch
convolution einsum einsum-notation fisher ggn im2col jvp kfac ntk pytorch tensornetwork transpose-convolution vjp
Language:Python 12
yorkerlin / StructuredNGD-DL
Matrix-multiplication-only KFAC; Code for ICML 2023 paper on Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning
kfac natural-gradients optimization-methods optimizer pytorch-implementation second-order-optimization fisher deep-learning hessian-free
Language:Python 4
alirezakazemipour / ACKTR-PyTorch
a2c acktr kfac kfac-optimizer
Language:Python 1
rafonsor / unRL
unRL (AKA "unreal") is a set of libraries providing Reinforcement Learning algorithms implemented in PyTorch or Jax.
jax multi-armed-bandits reinforcement-learning artifical-intelligence policy-gradient pytorch actor-critic-methods dqn ddpg deep-reinforcement-learning ppo kfac
Language:Python 0