fudan-zvg / diffusion-square

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Diffusion²: Dynamic 3D Content Generation via Score Composition of Orthogonal Diffusion Models

Paper

Diffusion²: Dynamic 3D Content Generation via Score Composition of Orthogonal Diffusion Models,
Zeyu Yang*, Zijie Pan*, Chun Gu, Li Zhang
Fudan University
Arxiv preprint

This repository is the official implementation of "Diffusion²: Dynamic 3D Content Generation via Score Composition of Orthogonal Diffusion Models". In this paper, we propose to achieve 4D generation from directly sampling the dense multi-view multi-frame observation of dynamic content by composing the estimated score of pretrained video and multi-view diffusion models that have learned strong prior of dynamic and geometry.

🛠️ Pipeline


📊 Results

🖼️ Image-to-4D Generation


🖼️ 4D Generatin from Single-view Video


🖼️ Animating Static 3D assets


🖼️ Ablation


📜 Reference

@article{yang2024diffusion,
  title={Diffusion²: Dynamic 3D Content Generation via Score Composition of Orthogonal Diffusion Models},
  author={Yang, Zeyu and Pan, Zijie and Gu, Chun and Zhang, Li},
  journal={arXiv preprint 2404.02148},
  year={2024}
}

About