KimRass / Swin-Transformer

PyTorch implementation of 'Swin Transformer' (Liu et al., 2021) from scratch.

Swin Transformer: Hierarchical Vision Transformer using Shifted Windows

To-Dos

• Patch partition
• Patch merging
• Relative position bias
• Feature map padding
• Self-attention in non-overlapped windows
• Shifted Window based Self-Attention