9ac0b487ac
Make --gpu-only put intermediate values in GPU memory instead of cpu.
12 months ago
9b655d4fd7
Fix memory issue with control loras.
12 months ago
13fdee6abf
Try to free memory for both cond+uncond before inference.
12 months ago
dd4ba68b6e
Allow different models to estimate memory usage differently.
1 year ago
036f88c621
Refactor to make it easier to add custom conds to models.
1 year ago
0d45a565da
Fix memory issue related to control loras.
...
The cleanup function was not getting called.
1 year ago
1adcc4c3a2
Add a SamplerCustom Node.
...
This node takes a list of sigmas and a sampler object as input.
This lets people easily implement custom schedulers and samplers as nodes.
More nodes will be added to it in the future.
1 year ago
bf3fc2f1b7
Refactor sampling related code.
1 year ago
77a176f9e0
Use common function to reshape batch to.
1 year ago
51dde87e97
Try to free enough vram for control lora inference.
1 year ago
be9c5e25bc
Fix issue with not freeing enough memory when sampling.
1 year ago
ac0758a1a4
Fix bug with lowvram and controlnet advanced node.
1 year ago
89a0767abf
Smarter memory management.
...
Try to keep models on the vram when possible.
Better lowvram mode for controlnets.
1 year ago
ddc6f12ad5
Disable autocast in unet for increased speed.
1 year ago
4eab00e14b
Set the seed in the SDE samplers to make them more reproducible.
1 year ago
1201d2eae5
Make nodes map over input lists ( #579 )
...
* allow nodes to map over lists
* make work with IS_CHANGED and VALIDATE_INPUTS
* give list outputs distinct socket shape
* add rebatch node
* add batch index logic
* add repeat latent batch
* deal with noise mask edge cases in latentfrombatch
2 years ago
d3293c8339
Properly disable all progress bars when disable_pbar=True
2 years ago
5a971cecdb
Add callback to sampler function.
...
Callback format is: callback(step, x0, x)
2 years ago
aa57136dae
Some fixes to the batch masks PR.
2 years ago
c50208a703
Refactor more code to sample.py
2 years ago
0b07b2cc0f
gligen tuple
2 years ago
d9b1595f85
made sample functions more explicit
2 years ago
5818539743
add docstrings
2 years ago
2a09e2aa27
refactor/split various bits of code for sampling
2 years ago
comfyanonymous
BlenderNeko