dgenerate.promptweighters.constants.PROMPT_WEIGHTER_GPU_MEMORY_CONSTRAINTS = ['memory_required > (available * 0.70)']

Cache constraint expressions for when to attempt to clear cuda VRAM upon a prompt weighter plugin calling dgenerate.promptweighters.PromptWeighter.memory_guard_device() on a cuda device, syntax provided via dgenerate.memory.gpu_memory_constraints()

If any of these constraints are met, an effort is made to clear modules off a GPU which are cached for fast repeat usage but are okay to flush.

The only available extra variable is: memory_required, which is the amount of memory the prompt weighter plugin requested to be available.

dgenerate.promptweighters.constants.PROMPT_WEIGHTER_CACHE_GC_CONSTRAINTS = ['memory_required > (available * 0.70)']

Cache constraint expressions for when to attempt to clear objects out of any CPU side cache upon a prompt weighter plugin calling dgenerate.promptweighters.PromptWeighter.memory_guard_device() on the cpu, syntax provided via dgenerate.memory.memory_constraints()

If any of these constraints are met, an effort is made to clear objects out of any named CPU side cache.

The only available extra variable is: memory_required, which is the amount of memory the prompt weighter plugin requested to be available.

dgenerate.promptweighters.constants.PROMPT_WEIGHTER_CACHE_MEMORY_CONSTRAINTS = ['memory_required > (available * 0.70)']

Cache constraint expressions for when to attempt to clear specifically the prompt weighter object cache upon a prompt weighter plugin calling dgenerate.promptweighters.PromptWeighter.memory_guard_device() on the cpu, syntax provided via dgenerate.memory.memory_constraints()

If any of these constraints are met, an effort is made to clear objects out of the prompt weighter object cache.

Available extra variables are: memory_required, which is the amount of memory the prompt weighter plugin requested to be available, and cache_size which is the current size of the prompt weighter object cache.