IShengFang / ResNet-DenseNet-Notebook

using keras to build the residual or dense block

ResNet-DenseNet-Notebook

This Jupyter notebook is using keras to build the residual or dense block, and compare with four models in cifar100 classification as following.

• 18 layers residual network with ReLU and batch normalization
• 18 layers plain network with ReLU and batch normalization
• 18 layers residual network with SELU
• 18 layers plain network with SELU

All model was trained with 100 epochs and Adam(learning rate:$10^{-5}$)

TL;DR

Residual Block Plot

Loss

Accuracy

Whole Model plot

Residual Network with ReLU and batch normalization

Residual Network with SELU