neural-tangent-kernel

There are 1 repository under neural-tangent-kernel topic.

• MinghuiChen43 / awesome-deep-phenomena

  A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...

  awesome-listdeep-learning-theorydouble-descentemergenceempirical-researchgrokkinginformation-bottleneck-theorylottery-ticket-hypothesisneural-collapseneural-tangent-kernelneuroscience-inspired-ainon-convex-optimizationphase-transitions
  212

• tfjgeorge / nngeometry

  {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch

  ek-facekfacfimfisher-information-matrixgramjacobiank-fackfacneural-tangent-kernelntkpytorchtangent
  Language:Python 193

• MadryLab / trak

  A fast, effective data attribution method for neural networks in PyTorch

  attributiondeep-learningmachine-learningneural-tangent-kernelpytorch
  Language:Python 139

• google-deepmind / dks

  Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural network models (and their initializations) to make them easier to train.

  artificial-intelligencedeep-learningjaxmachine-learningneural-networksneural-tangent-kernelpytorchtensorflow
  Language:Python 52

• james-simon / eigenlearning

  codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"

  deep-learningdeep-learning-theoryneural-tangent-kernelneural-tangentseigenvalues
  Language:Jupyter Notebook 49

• 392781 / scikit-ntk

  Neural Tangent Kernel (NTK) module for the scikit-learn library

  neural-tangent-kernelntkscikitscikit-learnkernel-methodsmachine-learning
  Language:Python 21

• Model-Compression / Lossless_Compression

  We propose a lossless compression algorithm based on the NTK matrix for DNN. The compressed network yields asymptotically the same NTK as the original (dense and unquantized) network, with its weights and activations taking values only in {0, 1, -1} up to scaling.

  deep-learningmodel-compressionneural-tangent-kernel
  Language:Python 21

• RonyAbecidan / Neural-Thompson-Sampling

  Study of the paper 'Neural Thompson Sampling' published in October 2020

  neural-networkneural-tangent-kernelthompson-samplingneural-thompson-samplingmulti-armed-banditscontextual-banditsnon-linear-optimization
  Language:Jupyter Notebook 17

• DLR-RM / moegplib

  Official Code: Trust Your Robots! Predictive Uncertainty Estimation of Neural Networks with Sparse Gaussian Processes

  uncertainty-neural-networksuncertainty-quantificationcorlgaussian-processesneural-tangent-kernel
  Language:Python 9

• Rubiksman78 / Pole_projet_PINN

  TF2 Implementation of Physics Informed Neural Networks and Neural Tangent Kernel

  neural-tangent-kernelphysics-informed-neural-networkstensorflow2
  Language:Python 9

• TimoFlesch / NeuralTangentKernel

  A Python implementation of the Neural Tangent Kernel (jacot et al, 2018)

  neural-tangent-kernelntklearning-theory
  Language:Jupyter Notebook 8

• forgi86 / RNN-adaptation

  Code accompanying the paper "On the adaptation of recurrent neural networks for system identification"

  deep-learningdynamical-systemsgaussian-processesjacobian-vector-productneural-tangent-kerneltransfer-learning
  Language:Python 7

• kwignb / RandomNeuralField

  Implementation of "Deep Learning in Random Neural Fields: Numerical Experiments via Neural Tangent Kernel"

  deep-learningneural-tangent-kernelneural-networksneural-fieldsnumerical-experiments
  Language:Jupyter Notebook 5

• tanzh-lamda / RKME-NTK-Learnware-Specification

  Code for "Learnware Reduced Kernel Mean Embedding Specification Based on Neural Tangent Kernel"

  learnwarelearnware-marketmachine-learningneural-tangent-kernel
  Language:Python 5

• 392781 / neural-laplace

  Empirical analysis of the Laplace and neural tangent kernel reproducing kernel Hilbert space (RKHS)

  neural-tangent-kernelntkreproducing-kernelrkhslaplace-kernelreproducing-kernel-hilbert-space
  Language:Jupyter Notebook 4

• yaodongyu / TCT

  TCT: Convexifying Federated Learning using Bootstrapped Neural Tangent Kernels

  federated-learningneural-tangent-kerneloptimization
  Language:Python 4

• smithhenryd / NN-Kernel-and-Rich-Regimes

  Senior Project for Statistics & Data Science at Yale University

  deep-learninggradient-descentgradient-flowlinear-regressionneural-networkneural-tangent-kerneloptimizationpythontensorflow
  Language:TeX 3

• genglinliu / NTK-study

  Understand the spectral bias of deep learning through the study of NTK

  neural-tangent-kernel
  Language:Jupyter Notebook 2

• smithhenryd / Lazy-Training

  Yale S&DS 432 final project studying lazy training dynamics for differentiable optimization problems

  deep-learninggradient-descentgradient-flowneural-networkneural-networksneural-tangent-kerneloptimizationprobability-statistics
  Language:TeX 1

• YconquestY / 6.s088

  Coursework of MIT 6.S088

  machine-learningneural-tangent-kernel
  Language:Jupyter Notebook 1

• bandofstraycats / naq

  Implementation of Approximate Smooth Kernel Value Iteration

  approximate-dynamic-programmingneural-tangent-kernelreinforcement-learning
  Language:Python

• iurada / px-ntk-pruning

  Official repository of our work "Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning" accepted at CVPR 2024

  artificial-intelligencedeep-learninginterpretable-deep-learningneural-tangent-kernelpruning-at-initialization
  Language:Python

• ZouWenXuan / Spike-and-Slab-RNN

  Code for paper

  ensemble-learningneural-tangent-kernelrecurrent-neural-networks
  Language:Jupyter Notebook