james-simon

eigenlearning

codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"

reverse-engineering

Example notebooks for Reverse Engineering the Neural Tangent Kernel

dnn_mode_connectivity

source code for neural network mode connectivity project looking for a percolation transition; effectively forked from https://github.com/timgaripov/dnn-mode-connectivity

james-simon.github.io

bairblog.github.io

BIG-bench

Beyond the Imitation Game collaborative benchmark for enormous language models

cell-fight

a cellular combat simulator. if you've ever wanted to fight an amoeba, this is your chance

circuit-superposition

tests of an alternate neural net formulation that does a computation equivalent to an exponential number of binary logic circuits in parallel

deweese-lab.github.io

mup

maximal update parametrization (µP)

qubit-control

code base for simulations and plot generation for https://arxiv.org/abs/2001.10029

sailbot

SailBOT autonomous navigational code written in Python.

varnets

variant networks using nonlinear mixing operations. this is just a workspace for a paper in progress

wordLadderFinder

Finds groups of words in a dictionary that can be connected by word ladders