Generative AI for the Blender VSE: Text, video or image to video, image and audio in Blender Video Sequence Editor.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

30 lines
1.4 KiB

2 years ago
# Text to Video
2 years ago
Adding text to video to the Blender Video Sequence Editor using ModelScope.
2 years ago
2 years ago
It needs 20 GB of VRAM to run, this and impossible download times, makes me give up this project for now.
2 years ago
## How to install
2 years ago
Run Blender as Administrator and open the system console(Blender system console processsing can be stopped with Ctrl + C) before clicking the Generate Movie button, so you can see how it is progressing the module installation. It'll take a lot of time, since it is a huge and slow download.
2 years ago
2 years ago
If some additional python modules are missing, write about it here(so I can add them), and use the Blender PIP add-on to manually install the missing modules: https://github.com/amb/blender_pip
2 years ago
Alternative download for the weighted set which needs 20 GB of VRAM to run:
2 years ago
https://modelscope.cn/models/damo/text-to-video-synthesis/files
2 years ago
2 years ago
Or a pruned weighted set which should be able to run on 6GB VRAM:
2 years ago
https://huggingface.co/kabachuha/modelscope-damo-text2video-pruned-weights/tree/main
2 years ago
The downloaded models should be placen in this folder: C:\Users\Your_user_name\AppData\Roaming\Blender Foundation\Blender\3.4\scripts\addons\text_to_video-main\model
2 years ago
2 years ago
## Location
Video Sequence Editor > Sidebar > Text to Video
![image](https://user-images.githubusercontent.com/1322593/226438089-2c81fceb-6cfd-4c72-b79e-e83b97b2f8f6.png)
2 years ago
## Module
ModelScope: https://modelscope.cn/models/damo/text-to-video-synthesis/summary
2 years ago