Qian Wang, Weiqi Li, Chong Mou, Xinhua Cheng, Jian Zhang
School of Electronic and Computer Engineering, Peking University
This repository is the official implementation of 360DVD, a panorama video generation pipeline based on the given prompts and motion conditions. The main idea is to turn a T2V model into a panoramic T2V model through 360-Adapter and 360 Enhancement Techniques.
- 360DVD has been accepted by CVPR2024!
- Release weights
- Release code
- Release paper
- Release dataset
We have showcased some regular videos generated by AnimateDiff and panoramic videos generated by 360DVD below.
More results can be found on our Project Page.
Model: Realistic Vision V5.1
WEB360 with 2114 360-degree panoramic videos, each with 100 frames at a resolution of 512x1024, can be downloaded at Google Drive.
Qian Wang: qianwang@stu.pku.edu.cn
Codebase built upon AnimateDiff.
@article{wang2024360dvd,
title={360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Model},
author={Qian Wang and Weiqi Li and Chong Mou and Xinhua Cheng and Jian Zhang},
journal={arXiv preprint arXiv:2401.06578},
year={2024}
}