colt626 / stable-video-diffusion-colab

🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🚦 WIP 🚦

🦒 Colab

Colab	Info
	stable_video_diffusion_fp16_colab
	stable_video_diffusion_img2vid.ipynb (Thanks to @mkshing ❤)

Tutorial

If you get an UnidentifiedImageError, please run the example first or use 1024x576 JPG or PNG images.

Main Repo

https://github.com/Stability-AI/generative-models
https://huggingface.co/spaces/multimodalart/stable-video-diffusion/blob/main/app.py

Paper

https://arxiv.org/abs/2311.15127
https://static1.squarespace.com/static/6213c340453c3f502425776e/t/655ce779b9d47d342a93c890/1700587395994/stable_video_diffusion.pdf

Page

https://stability.ai/news/stable-video-diffusion-open-ai-video-model

Model

https://huggingface.co/stabilityai/stable-video-diffusion-img2vid
https://huggingface.co/stabilityai/stable-video-diffusion-img2vid-xt

Output

000006.mp4

000002.mp4

000001.mp4

000000.1.mp4

000001.3.mp4