Text-To-Video-Finetuning-colab

🐣 Please follow me for new updates https://twitter.com/camenduru 🔥 Please join our discord server https://discord.gg/k5BwmmvJJU 🥳 Please join my patreon community https://patreon.com/camenduru

🦒 Colab

Colab	Info
	dataset
	train
	train single video
	inference

Data

https://github.com/microsoft/XPretrain/tree/main/hd-vila-100m (HD-VILA-100M Dataset) http://toflow.csail.mit.edu/ (Vimeo-90k Dataset) https://github.com/m-bain/webvid Movie Trailers

Tag

https://github.com/Breakthrough/PySceneDetect https://github.com/ExponentialML/Video-BLIP2-Preprocessor

Main Repo

https://github.com/ExponentialML/Text-To-Video-Finetuning

🚦 Prototype 🚦

Potat 1️⃣

Model: https://huggingface.co/camenduru/potat1 Dataset: https://huggingface.co/camenduru/potat1_dataset/tree/main

Potat 1️⃣ Output

https://github.com/camenduru/Text-To-Video-Finetuning-colab/assets/54370274/97282de4-e1df-49a0-851e-cb8b4b040441

Please try it 🐣

https://github.com/camenduru/text-to-video-synthesis-colab