- dgenerate.promptupscalers.constants.PROMPT_UPSCALER_GPU_MEMORY_CONSTRAINTS = ['memory_required > (available * 0.70)']
Cache constraint expressions for when to attempt to clear gpu VRAM upon a prompt upscaler plugin calling
dgenerate.promptupscalers.PromptUpscaler.memory_guard_device()on a cuda device, syntax provided viadgenerate.memory.gpu_memory_constraints()If any of these constraints are met, an effort is made to clear modules off a GPU which are cached for fast repeat usage but are okay to flush.
The only available extra variable is:
memory_required, which is the amount of memory the prompt upscaler plugin requested to be available.
- dgenerate.promptupscalers.constants.PROMPT_UPSCALER_CACHE_GC_CONSTRAINTS = ['memory_required > (available * 0.70)']
Cache constraint expressions for when to attempt to clear objects out of any CPU side cache upon a prompt upscaler plugin calling
dgenerate.promptupscalers.PromptUpscaler.memory_guard_device()on the cpu, syntax provided viadgenerate.memory.memory_constraints()If any of these constraints are met, an effort is made to clear objects out of any named CPU side cache.
The only available extra variable is:
memory_required, which is the amount of memory the prompt upscaler plugin requested to be available.
- dgenerate.promptupscalers.constants.PROMPT_UPSCALER_CACHE_MEMORY_CONSTRAINTS = ['memory_required > (available * 0.70)']
Cache constraint expressions for when to attempt to clear specifically the prompt upscaler object cache upon a prompt upscaler plugin calling
dgenerate.promptupscalers.PromptUpscaler.memory_guard_device()on the cpu, syntax provided viadgenerate.memory.memory_constraints()If any of these constraints are met, an effort is made to clear objects out of the prompt upscaler object cache.
Available extra variables are:
memory_required, which is the amount of memory the prompt upscaler plugin requested to be available, andcache_sizewhich is the current size of the prompt upscaler object cache.