double-descent

There are 1 repository under double-descent topic.

• MinghuiChen43 / awesome-deep-phenomena

  A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...

  awesome-listdeep-learning-theorydouble-descentemergenceempirical-researchgrokkinginformation-bottleneck-theorylottery-ticket-hypothesisneural-collapseneural-tangent-kernelneuroscience-inspired-ainon-convex-optimizationphase-transitions
  192
• mdl-complexity

  csinva / mdl-complexity

  MDL Complexity computations and experiments from the paper "Revisiting complexity and the bias-variance tradeoff".

  complexitylinear-modelslinear-regressionmachine-learningaistatisticslinear-regression-modelsartificial-intelligencemdlminimum-description-lengthdouble-descentmean-squared-errorbias-variance-tradeoffbias-variance-traderidge-regressionmodel-selectioninformation-theory
  Language:Jupyter Notebook 17

• RylanSchaeffer / Stanford-AI-Alignment-Double-Descent-Tutorial

  Code for Arxiv Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle

  deep-learningdouble-descentmachine-learning
  Language:Python 12

• antonior92 / narx-double-descent

  Explore the double-descent phenomena in the context of system identification. Companion code to the paper (https://arxiv.org/abs/2012.06341):

  double-descentmachine-learningnarxsystem-identification
  Language:Python 6

• ZhangXiao96 / OptimizationVariance

  This repository is the official implementation of "Optimization Variance: Delve into the Epoch-Wise Double Descent of DNNs"

  dnndeep-learninggeneralizationdouble-descentoptimizationvariance
  Language:Python 4

• akashsonowal / interpolating-neural-networks

  Interpolating Neural Networks in Asset Pricing Data. Supports Distributed Training in TensorFlow.

  asset-pricingdeep-learningdouble-descentneural-networks
  Language:Python 1

• josch14 / double-descent

  Double Descent results for FCNNs on MNIST, extended by Label Noise (Reconciling Modern Machine-Learning Practice and the Classical Bias–Variance Trade-Off).

  double-descentfully-connected-neural-networklabel-noisemlpweight-reuse
  Language:Python 1

• nplotko / double-descent-lr

  This project outlines 4 experiments to explore the effects of several settings on the bias-variance tradeoff curve

  double-descentgpulinear-regressionmachine-learningregressionoverparameterization
  Language:Jupyter Notebook 1

• sidak / double-descent

  ICLR 2022: Phenomenology of Double Descent in Finite-width Neural Networks

  deep-learningdouble-descentgeneralizationhessianneural-networks
  1

• VictorZXY / dnn-assignments

  Assignments of my CST Part II Deep Neural Networks unit

  adversarial-examplesdeep-learningdouble-descentmachine-learningpytorchrecurrent-neural-networksresidual-neural-networksstochastic-gradient-descent
  Language:Jupyter Notebook 1

• fpgdubost / CIFAR-10-optimization

  Toy dataset to study double descent optimization patterns in machine learning.

  double-descentmachine-learning
  Language:Python 0

• ShawnGeorge03 / STAD80-Review_Of_Double_Descent

  A Review of Preetum Nakkiran's "More Data Can Hurt for Linear Regression: Sample-wise Double Descent"

  double-descentlinear-regression
  Language:TeX