KV cache: per-conversation slot separation + disk persistence/offload#1830

Open

aidiffuser wants to merge 5 commits intoexo-explore:mainfrom

aidiffuser:kv-cache-disk-persistence

Commits on Apr 1, 2026

KV cache: per-conversation slot separation + disk persistence
aidiffuser
committed

Commits on Apr 3, 2026

KV cache: ensure disk dir exists before flush
aidiffuser
committed

Commits on Apr 7, 2026

KV cache: 500GB disk size cap, force flush on idle
aidiffuser
committed
KV cache: configurable disk persistence via environment variables
aidiffuser
committed

Commits on Apr 9, 2026

KV cache: filter empty arrays on flush for GLM/non-standard architectures
aidiffuser
committed