dgenerate.latentsprocessors.constants.LATENTS_PROCESSOR_GPU_MEMORY_CONSTRAINTS = ['memory_required > (available * 0.70)']

Cache constraint expressions for when to attempt to clear gpu VRAM upon a latents processor plugin calling dgenerate.latentsprocessors.LatentsProcessor.memory_guard_device() on a cuda device, syntax provided via dgenerate.memory.gpu_memory_constraints()

If any of these constraints are met, an effort is made to clear modules off a GPU which are cached for fast repeat usage but are okay to flush.

The only available extra variable is: memory_required, which is the amount of memory the latents processor plugin requested to be available.

dgenerate.latentsprocessors.constants.LATENTS_PROCESSOR_CACHE_GC_CONSTRAINTS = ['memory_required > (available * 0.70)']

Cache constraint expressions for when to attempt to clear objects out of any CPU side cache upon a latents processor plugin calling dgenerate.latentsprocessors.LatentsProcessor.memory_guard_device() on the cpu, syntax provided via dgenerate.memory.memory_constraints()

If any of these constraints are met, an effort is made to clear objects out of any named CPU side cache.

The only available extra variable is: memory_required, which is the amount of memory the latents processor plugin requested to be available.

dgenerate.latentsprocessors.constants.LATENTS_PROCESSOR_CACHE_MEMORY_CONSTRAINTS = ['memory_required > (available * 0.70)']

Cache constraint expressions for when to attempt to clear specifically the latents processor object cache upon a latents processor plugin calling dgenerate.latentsprocessors.LatentsProcessor.memory_guard_device() on the cpu, syntax provided via dgenerate.memory.memory_constraints()

If any of these constraints are met, an effort is made to clear objects out of the latents processor object cache.

Available extra variables are: memory_required, which is the amount of memory the latents processor plugin requested to be available, and cache_size which is the current size of the latents processor object cache.