camenduru/text-to-video-synthesis-colab

🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🦒 Colab

| Colab | Type | --- | --- | | longscope_text_to_video_colab polyware-ai/longscope
(Thanks to @polyware_ai ❤ for the model) | zeroscope_v2_xl_text_to_video_colab cerspense/zeroscope_v2_XL
(Thanks to @cerspense ❤ for the model) | zeroscope_v2_576w_text_to_video_colab cerspense/zeroscope_v2_576w
(Thanks to @cerspense ❤ for the model) | potat1_exp1_text_to_video_colab (Thanks to lambda labs ❤ for the gpu) | zeroscope_v2_dark_text_to_video_colab cerspense/zeroscope_v2_dark_30x448x256
(Thanks to @cerspense ❤ for the model) | zeroscope_v2_30x448x256_text_to_video_colab cerspense/zeroscope_v2_30x448x256
(Thanks to @cerspense ❤ for the model) | zeroscope_v1_1_320s_text_to_video_colab cerspense/zeroscope_v1-1_320s
(Thanks to @cerspense ❤ for the model) | potat1_text_to_video_colab camenduru/potat1 (Thanks to lambda labs ❤ for the gpu) | zeroscope_v1_320s_text_to_video_colab cerspense/zeroscope_v1_320s
(Thanks to @cerspense ❤ for the model) | ms_1_7b_text_to_video_colab damo-vilab/text-to-video-ms-1.7b
(Thanks to damo ❤ damo-vilab ❤ for the model) | animov_512x_text_to_video_colab strangeman3107/animov-512x
(Thanks to @bRuefiRe ❤ for the model) | animov_0_1_1_text_to_video_colab strangeman3107/animov-0.1.1
(Thanks to @bRuefiRe ❤ for the model) | animov_0_1_text_to_video_colab strangeman3107/animov-0.1.1
(Thanks to @bRuefiRe ❤ for the model) | Watermark Remover | text_to_video_synthesis
(Thanks to damo ❤ damo-vilab ❤ for the model) | text_to_video_synthesis_diffusers
(Thanks to damo ❤ damo-vilab ❤ for the model)

🦒 Community Colab

| Colab | Function | Author | Readme | --- | --- | --- | --- | | potat1_text_to_video_colab_ALM (Thanks to snydjos ❤) | snydjos AILostMedia | Readme

Tutorials

https://www.youtube.com/watch?v=WHcjD-uraUs (for zeroscope_video_webui_colab and zeroscope_upscale_video_webui_colab)
https://www.youtube.com/watch?v=E45AO1w9gRU (for Potat 1️⃣ and Zeroscope)
https://www.youtube.com/watch?v=b8D4am73e6I

Main Repo

https://www.modelscope.cn/models/damo/text-to-video-synthesis/summary
https://github.com/modelscope/modelscope
https://github.com/huggingface/diffusers

Paper

https://arxiv.org/abs/2308.06571

Models License

Apache License 2.0

Examples

Potat 1️⃣

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/604a8817-5ad3-421a-9240-e5d3b195074d

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/842da028-df43-4dba-bb14-a41d66edeb4e

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/c5201c8a-2815-4533-9474-1e312c564f4e

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/281d1a9e-b930-4e8a-9554-5203e15b4425

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/0bb74810-13bf-4e20-950f-b569a60ea5c8

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/1025f302-9fa1-4bd3-8996-1da94697151e

Base Model

A giraffe underneath a microwave.	A goldendoodle playing in a park by a lake.	A panda bear driving a car.
A teddy bear running in New York City.	Drone flythrough of a fast food restaurant on a dystopian alien planet.	A dog wearing a Superhero outfit with red cape flying through the sky.
Monkey learning to play the piano.	A litter of puppies running through the yard.	Robot dancing in times square.

Related Colab

https://github.com/camenduru/text2video-zero-colab