lightonai / double-trouble-in-double-descent

Double Trouble in the Double Descent Curve with Optical Processing Units.

Random projections did it again!

This is the code to reproduce Figure 7 of "Random projections did it again!" blog post on Medium inspired by Double Trouble in Double Descent : Bias and Variance(s) in the Lazy Regime.

This script recovers the effect of ensembling on the double descent curve using random projections plus a ridge classifier solved via SVD.

Access to Optical Processing Units

To request access to LightOn Cloud and try our photonic co-processor, please visit: https://cloud.lighton.ai/

For researchers, we also a LightOn Cloud for Research program, please visit https://cloud.lighton.ai/lighton-research/ for more information.

Running the experiment

python double_trouble.py  

Running double_trouble.py outputs a .npz file. To plot the results using this file look at the double_trouble_plot.py example.