From da6f56235ba39bda3d19f8e1cc61c085f32fb7c9 Mon Sep 17 00:00:00 2001 From: comfyanonymous Date: Sun, 29 Jan 2023 13:15:03 -0500 Subject: [PATCH] Add section to readme explaining how to get better speeds. --- README.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/README.md b/README.md index e74c897b..6dd0ea12 100644 --- a/README.md +++ b/README.md @@ -66,6 +66,14 @@ Dragging a generated png on the webpage or loading one will give you the full wo You can use () to change emphasis of a word or phrase like: (good code:1.2) or (bad code:0.8). The default emphasis for () is 1.1. To use () characters in your actual prompt escape them like \\( or \\). +## How to increase generation speed? + +The fp16 model configs in the CheckpointLoader can be used to load them in fp16 mode, depending on your GPU this will increase your gen speed by a significant amount. + +You can also set this command line setting to disable the upcasting to fp32 in some cross attention operations which will increase your speed. Note that this will very likely give you black images on SD2.x models. + +```--dont-upcast-attention``` + ### Colab Notebook To run it on colab you can use my [Colab Notebook](notebooks/comfyui_colab.ipynb) here: [Link to open with google colab](https://colab.research.google.com/github/comfyanonymous/ComfyUI/blob/master/notebooks/comfyui_colab.ipynb)