i008 / dsr-pytorch

pytorch tutorial

Download to data directory

https://s3.eu-central-1.amazonaws.com/i008data/fashion-mnist_train.csv
https://s3.eu-central-1.amazonaws.com/i008data/fashion-mnist_test.csv
https://s3.eu-central-1.amazonaws.com/i008data/small_sneaker_not_sneaker.tar.gz

Environment

conda env update
conda install nb_conda
source activate dl
python -m ipykernel install --user --name dl --display-name "dsr-dl"

If you dont have a GPU in your system remove the cudatoolkit from the environment.yml file

python test_env.py

Commands

tensorboard --port=8888 --logdir runs

Pytorch and nn-basics

Pytorch basics
The simplest neural network - perceptron
Dataset and Dataloader

Pytorch frameworks and logging

Perceptron trained with skorch
Perceptron trained and logged with tensorboard Perceptron trained with Catalyst

Python

Python refresher

Fundamentals

Convolutions basics

FashionMnist CNN training

Training FashionMnist
Training FashionMnist with neptune logging

Transfer learning

Training FashionMnist with transfer-learning

Deep Learning advanced concepts

Finding the right learning rate
Batch normalization Grad CAM

Project 1 - Sneaker Not Sneaker

Sneaker not Sneaker transfer learning

Project 2 - Segmentation

Segmentation Dataset Segmentation Models

Object Detection

Detecting Shapes with Retinanet

Representaional Learning

Auto Encoder Variational Auto Encoder

Tabular Deep Learning

Tabular Embeddings Adult Salaries with DL