Generative AI for the Blender VSE: Text, video or image to video, image and audio in Blender Video Sequence Editor.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

1.2 KiB

Text to Video

Adding text to video to the Blender Video Sequence Editor using ModelScope.

It needs 20 GB of VRAM to run, this and impossible download times, makes me give up this project for now.

Dunno if this is actually working, I'm still in the process of downloading the 12 GB models...

How to install

Run Blender as Administrator and open the system console before clicking the Generate Movie button, so you can see how it is progressing the module installation. It'll take a lot of time, since it is a 12GB download.

If some additional python modules are missing, write about it here(so I can add them), and use the Blender PIP add-on to manually install the missing modules: https://github.com/amb/blender_pip

If the weights takes forever to download they can be downloaded here: https://modelscope.cn/models/damo/text-to-video-synthesis/files

Btw. the Blender system console processsing can be stopped with Ctrl + C

Location

Video Sequence Editor > Sidebar > Text to Video

image

Module

ModelScope: https://modelscope.cn/models/damo/text-to-video-synthesis/summary