yizhe-ang / interactive-transformer

A visual interface for understanding and interpreting Transformers

The Interactive Transformer

🚧 work in progress 🚧

interactive_transformer_demo.mp4

Setup

git clone https://github.com/yizhe-ang/interactive-transformer.git

Launch Backend

cd python

Install Python environment

poetry install

For non-CUDA CPU version, additionally run:

poetry source add -p explicit pytorch https://download.pytorch.org/whl/cpu
poetry add --source pytorch torch torchvision

Launch the backend server

poetry shell

uvicorn main:app --reload

Launch Application

cd svelte

Install dependencies

npm install --force

Launch application

npm run dev

The application will run by default on http://localhost:5173/