Reimplementation of BCD for DNNs in Global Convergence of Block Coordinate Descent in Deep Learning (Zeng et al., 2019), appearing in ICML 2019, in PyTorch (See also T. T.-K. Lau et al. (2018)) with the MNIST dataset.
bcd_dnn_mlp_mnist.ipynb: 3-layer MLP, MNIST
bcd_dnn_mlp_mnist_deep.ipynb: 10-layer MLP, MNIST
bcd_dnn_mlp_mnist_deep_ics.ipynb: 10-layer MLP, MNIST, with internal covariate shift (ICS)