🐣 Please follow me for new updates https://twitter.com/camenduru 🔥 Please join our discord server https://discord.gg/k5BwmmvJJU 🥳 Please join my patreon community https://patreon.com/camenduru

🚦 WIP 🚦

🦒 Colab

Colab	Info
	stable_video_diffusion_fp16_colab
	stable_video_diffusion_img2vid.ipynb (Thanks to @mkshing ❤)

Tutorial

If you get an UnidentifiedImageError, please run the example first or use 1024x576 JPG or PNG images.

Main Repo

https://github.com/Stability-AI/generative-models https://huggingface.co/spaces/multimodalart/stable-video-diffusion/blob/main/app.py

Paper

https://arxiv.org/abs/2311.15127 https://static1.squarespace.com/static/6213c340453c3f502425776e/t/655ce779b9d47d342a93c890/1700587395994/stable_video_diffusion.pdf

Page

https://stability.ai/news/stable-video-diffusion-open-ai-video-model

Model

https://huggingface.co/stabilityai/stable-video-diffusion-img2vid https://huggingface.co/stabilityai/stable-video-diffusion-img2vid-xt

Output

https://github.com/camenduru/stable-video-diffusion-colab/assets/54370274/a0c48028-dbbc-48fa-801b-f950ca068fca

https://github.com/camenduru/stable-video-diffusion-colab/assets/54370274/3a35915b-24c1-46c0-88c1-3fb11fac65bc

https://github.com/camenduru/stable-video-diffusion-colab/assets/54370274/f93ed645-349b-4ee9-99db-9d51426b2eed

https://github.com/camenduru/stable-video-diffusion-colab/assets/54370274/44f4ef22-3e9d-4b1f-9683-13306ffd0989

https://github.com/camenduru/stable-video-diffusion-colab/assets/54370274/68c800e4-4dd6-4637-9c4a-adbaae26fcf5