Official PyTorch implementation of DiffiT: Diffusion Vision Transformers for Image Generation.
Code and pretrained DiffiT models will be released soon !
DiffiT achieves a new SOTA FID score of 1.73 on ImageNet-256 dataset !
In addition, DiffiT sets a new SOTA FID score of 2.22 on FFHQ-64 dataset !
We introduce a new Time-dependent Multihead Self-Attention (TMSA) mechanism that jointly learns spatial and temporal dependencies and allows for attention conditioning with finegrained control.
- [12.04.2023] 🔥 DiffiT manuscript is now available on arXiv !
| Model | Dataset | Resolution | FID-50K | Inception Score |
|---|---|---|---|---|
| Latent DiffiT | ImageNet | 256x256 | 1.73 | 276.49 |
| Model | Dataset | Resolution | FID-50K | Inception Score |
|---|---|---|---|---|
| Latent DiffiT | ImageNet | 512x512 | 2.67 | 252.12 |
| Model | Dataset | Resolution | FID-50K |
|---|---|---|---|
| DiffiT | CIFAR-10 | 32x32 | 1.95 |
| DiffiT | FFHQ-64 | 64x64 | 2.22 |