13fdee6abf
Try to free memory for both cond+uncond before inference.
12 months ago
dd4ba68b6e
Allow different models to estimate memory usage differently.
1 year ago
036f88c621
Refactor to make it easier to add custom conds to models.
1 year ago
0d45a565da
Fix memory issue related to control loras.
...
The cleanup function was not getting called.
1 year ago
1adcc4c3a2
Add a SamplerCustom Node.
...
This node takes a list of sigmas and a sampler object as input.
This lets people easily implement custom schedulers and samplers as nodes.
More nodes will be added to it in the future.
1 year ago
bf3fc2f1b7
Refactor sampling related code.
1 year ago
77a176f9e0
Use common function to reshape batch to.
1 year ago
51dde87e97
Try to free enough vram for control lora inference.
1 year ago
be9c5e25bc
Fix issue with not freeing enough memory when sampling.
1 year ago
ac0758a1a4
Fix bug with lowvram and controlnet advanced node.
1 year ago
89a0767abf
Smarter memory management.
...
Try to keep models on the vram when possible.
Better lowvram mode for controlnets.
1 year ago
ddc6f12ad5
Disable autocast in unet for increased speed.
1 year ago
4eab00e14b
Set the seed in the SDE samplers to make them more reproducible.
1 year ago
1201d2eae5
Make nodes map over input lists ( #579 )
...
* allow nodes to map over lists
* make work with IS_CHANGED and VALIDATE_INPUTS
* give list outputs distinct socket shape
* add rebatch node
* add batch index logic
* add repeat latent batch
* deal with noise mask edge cases in latentfrombatch
2 years ago
d3293c8339
Properly disable all progress bars when disable_pbar=True
2 years ago
5a971cecdb
Add callback to sampler function.
...
Callback format is: callback(step, x0, x)
2 years ago
aa57136dae
Some fixes to the batch masks PR.
2 years ago
c50208a703
Refactor more code to sample.py
2 years ago
0b07b2cc0f
gligen tuple
2 years ago
d9b1595f85
made sample functions more explicit
2 years ago
5818539743
add docstrings
2 years ago
2a09e2aa27
refactor/split various bits of code for sampling
2 years ago
comfyanonymous
BlenderNeko