azybler / vit_train

Examples with ViT

This repository contains examples of trainer scripts.

Scripts

• train_mnist.py - Will train a Vision Transformers in PyTorch on MNIST Handwritten Digit Recognition (Based on the article)

Set up

• pip install vit_pytorch
• pip install tiny_grad
• pip install pycuda (if you wish to train with CUDA)