Qian Wang, Weiqi Li, Chong Mou, Xinhua Cheng, Jian Zhang
School of Electronic and Computer Engineering, Peking University
This repository is the official implementation of 360DVD, a panorama video generation pipeline based on the given prompts and motion conditions. The main idea is to turn a T2V model into a panoramic T2V model through 360-Adapter and 360 Enhancement Techniques.
We have showcased some regular videos generated by AnimateDiff and panoramic videos generated by 360DVD below.
More results can be found on our Project Page.
 |
 |
 |
 |
| "the top of a snow covered mountain range, with the sun shining over it" | "a view of fireworks exploding in the night sky over a city, as seen from a plane" | ||
 |
 |
 |
 |
| "a desert with sand dunes, blue cloudy sky" | "the city under cloudy sky, a car driving down the street with buildings" | ||
 |
 |
 |
 |
| "a large mountain lake, the lake surrounded by hills and mountains" | "a volcano with smoke coming out, mountains under clouds, at sunset" | ||
Model: Realistic Vision V5.1
- Release dataset
- Release weights
- Release code
- Release paper
Qian Wang: qianwang@stu.pku.edu.cn
Codebase built upon AnimateDiff.
@article{wang2024360dvd,
title={360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Model},
author={Qian Wang and Weiqi Li and Chong Mou and Xinhua Cheng and Jian Zhang},
journal={arXiv preprint arXiv:2401.06578},
year={2024}
}