alexjung / ParalleNet

PyTorch implementation of several LeNet based neural networks using parallel layers with live visualization.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ParalleNet

This project implements several network models:

  • A modified LeNet-5 [1] with parallel layers and achieves an accuracy of ~99% on the MNIST dataset
  • A modified version of this net using an Inception-Layer [2] achieving an accuracy of ~99% on the MNIST dataset

Epoch Train Loss visualization

Setup

Install all dependencies using the following command

$ pip install -r requirements.txt

Usage

[Optional] Start the visdom server for visualization

$ python -m visdom.server

Start the training procedure

$ python run.py MODEL DEVICE

with MODEL=parallenet/mininception and DEVICE=cpu/cuda

See epoch train loss live graph at http://localhost:8097.

The trained model will be exported as ONNX to lenet.onnx. The lenet.onnx file can be viewed with Netron.

References

[1] Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. "Gradient-based learning applied to document recognition." Proceedings of the IEEE, 86(11):2278-2324, November 1998.
[2] Szegedy, Christian, et al. "Going deeper with convolutions." Proceedings of the IEEE conference on computer vision and pattern recognition. 2015.

About

PyTorch implementation of several LeNet based neural networks using parallel layers with live visualization.


Languages

Language:Python 100.0%