da7a8df0d2
Put VAE key name in model config.
10 months ago
4871a36458
Cleanup some unused imports.
10 months ago
d76a04b6ea
Add unfinished ImageOnlyCheckpointSave node to save a SVD checkpoint.
...
This node is unfinished, SVD checkpoints saved with this node will
work with ComfyUI but not with anything else.
10 months ago
a7874d1a8b
Add support for the stable diffusion x4 upscaling model.
...
This is an old model.
Load the checkpoint like a regular one and use the new
SD_4XUpscale_Conditioning node.
11 months ago
5eddfdd80c
Refactor VAE code.
...
Replace constants with downscale_ratio and latent_channels.
11 months ago
824e4935f5
Add dtype parameter to VAE object.
11 months ago
ba07cb748e
Use faster manual cast for fp8 in unet.
11 months ago
9ac0b487ac
Make --gpu-only put intermediate values in GPU memory instead of cpu.
12 months ago
983ebc5792
Use smart model management for VAE to decrease latency.
12 months ago
c45d1b9b67
Add a function to load a unet from a state dict.
12 months ago
871cc20e13
Support SVD img2vid model.
1 year ago
410bf07771
Make VAE memory estimation take dtype into account.
1 year ago
6a491ebe27
Allow model config to preprocess the vae state dict on load.
1 year ago
cd4fc77d5f
Add taesd and taesdxl to VAELoader node.
...
They will show up if both the taesd_encoder and taesd_decoder or taesdxl
model files are present in the models/vae_approx directory.
1 year ago
0cf4e86939
Add some command line arguments to store text encoder weights in fp8.
...
Pytorch supports two variants of fp8:
--fp8_e4m3fn-text-enc (the one that seems to give better results)
--fp8_e5m2-text-enc
1 year ago
0a6fd49a3e
Print leftover keys when using the UNETLoader.
1 year ago
2455aaed8a
Allow model or clip to be None in load_lora_for_models.
1 year ago
2a134bfab9
Fix checkpoint loader with config.
1 year ago
6ec3f12c6e
Support SSD1B model and make it easier to support asymmetric unets.
1 year ago
430a8334c5
Fix some potential issues.
1 year ago
d44a2de49f
Make VAE code closer to sgm.
1 year ago
9a55dadb4c
Refactor code so model can be a dtype other than fp32 or fp16.
1 year ago
72188dffc3
load_checkpoint_guess_config can now optionally output the model.
1 year ago
9bfec2bdbf
Fix quality loss due to low precision
1 year ago
71713888c4
Print missing VAE keys.
1 year ago
7d401ed1d0
Add ldm format support to UNETLoader.
1 year ago
7931ff0fd9
Support SDXL inpaint models.
1 year ago
fe4c07400c
Fix "Load Checkpoint with config" node.
1 year ago
1300a1bb4c
Text encoder should initially load on the offload_device not the regular.
1 year ago
f92074b84f
Move ModelPatcher to model_patcher.py
1 year ago
c77f02e1c6
Move controlnet code to comfy/controlnet.py
1 year ago
15a7716fa6
Move lora code to comfy/lora.py
1 year ago
ec96f6d03a
Move text_projection to base clip model.
1 year ago
51dde87e97
Try to free enough vram for control lora inference.
1 year ago
cc44ade79e
Always shift text encoder to GPU when the device supports fp16.
1 year ago
00c0b2c507
Initialize text encoder to target dtype.
1 year ago
f081017c1a
Save memory by storing text encoder weights in fp16 in most situations.
...
Do inference in fp32 to make sure quality stays the exact same.
1 year ago
afcb9cb1df
All resolutions now work with t2i adapter for SDXL.
1 year ago
85fde89d7f
T2I adapter SDXL.
1 year ago
cf5ae46928
Controlnet/t2iadapter cleanup.
1 year ago
763b0cf024
Fix control lora not working in fp32.
1 year ago
199d73364a
Fix ControlLora on lowvram.
1 year ago
d08e53de2e
Remove autocast from controlnet code.
1 year ago
c9b562aed1
Free more memory before VAE encode/decode.
1 year ago
d6e4b342e6
Support for Control Loras.
...
Control loras are controlnets where some of the weights are stored in
"lora" format: an up and a down low rank matrice that when multiplied
together and added to the unet weight give the controlnet weight.
This allows a much smaller memory footprint depending on the rank of the
matrices.
These controlnets are used just like regular ones.
1 year ago
c28db1f315
Fix potential issues with patching models when saving checkpoints.
1 year ago
89a0767abf
Smarter memory management.
...
Try to keep models on the vram when possible.
Better lowvram mode for controlnets.
1 year ago
53f326a3d8
Support diffusers mini controlnets.
1 year ago
c8a23ce9e8
Support for yet another lora type based on diffusers.
1 year ago
c20583286f
Support diffuser text encoder loras.
1 year ago
comfyanonymous
City