MikhailKravets / vision_transformer

Discover how to build vision transformer from scratch with this comprehensive tutorial. Follow our step-by-step guide to create your own vision transformer.

Build and Train Vision Transformer from Scratch

This is the supplementary repository for the tutorial

Build and Train Vision Transformer from Scratch

Install

After you've cloned the repository, you need to install required packages.

Install for CPU / MPS

Run the following command to install packages:

pip install -r requirements.txt

Install for CUDA

Install PyTorch libraries with the command from official web-site:

pip install torch torchvision --index-url https://download.pytorch.org/whl/cu118

Then install the rest of the libraries with the command:

pip install -r requirements-cuda.txt