songweige / TATS

Official PyTorch implementation of TATS: A Long Video Generation Framework with Time-Agnostic VQGAN and Time-Sensitive Transformer (ECCV 2022)

songweige/TATS Issues

Loss starts to diverge When the discriminator opens
Updated 2 months ago5
VQVAE does not appear to be completely Time-Agnostic
Closed 4 months ago
Code issues in CausalSelfAttention module
Updated 4 months ago
Question on training the transformer
Closed 4 months ago5
audio-video generation on custom dataset
Closed 2 years ago8
Downsample and Upsample ratio for T dimension
Updated 6 months ago1
Unavailable MUGEN checkpoints
Closed 6 months ago2
Training on FaceForensics
Closed 6 months ago4
Where is the codebook loss
Closed 6 months ago1
Cannot open saved model parameters for MUGEN
Closed 2 years ago4
The Results about Audio to Video Generation Using AudioSet-Drum.
Updated a year ago
how to load GPT checkpoint?
Closed a year ago1
Question about training procedure when dataset is devided with train/test set.
Closed a year ago2
FileNotFoundError: [Errno 2] No such file or directory: 'datasets/UCF-101/train/metadata_16.pkl'
Closed 2 years ago1
On the Interpolation Transformer
Closed 2 years ago3
Script for training condition on text
Closed 2 years ago10
Way to future generate frames(infer) conditioned one or a few initial frames of a video sequence.
Closed 2 years ago2
Mugen checkpoint
Closed 2 years ago4
Pre-trained model for UCF-101 without class conditioning & Question about CCVS model for Fig.5(a)
Closed 2 years ago14
Training with custom dataset
Closed 2 years ago2
The Training of Interpolation Transformer
Closed 2 years ago1
Great Work!!!!!
Closed 2 years ago30
where to get 'i3d_pretrained_400.pt' & code for IS evaluation
Closed 2 years ago1
What about the text-to-video generation performance if additional VQVAE is applied on text tokens?
Closed 2 years ago1
Checkpoints for TATS-Hierarchical
Closed 2 years ago2
The dropout of Transformer
Closed 2 years ago7
Checkpoints of the interpolation Transformer and how to use it for inference?
Closed 2 years ago2
Training on single GPU
Closed 2 years ago4
Does the project support cuda11 and RTX3090?
Closed 2 years ago1
Environment Setting
Closed 2 years ago1
UCF-101 VQ-GAN Google Drive is not set to public
Closed 2 years ago1