(2/6) Cache inference at do_inference - #95

Open

ErlisLushtaku wants to merge 9 commits into

cache-stack/01-local-storefrom

cache-stack/02-do-inference

Commits on Aug 8, 2026

Add lazy descriptor-aware caching at do_inference.
ErlisLushtaku
committed
5c35ea6
Simplify PreparedModel and drop speculative secret scanning.
ErlisLushtaku
committed
4fa2a5f
Document why the lazy inference-cache helpers exist.
ErlisLushtaku
committed
285b65a
Limit cache input canonicalization to supported forms.
ErlisLushtaku
committed
e5f8c29
Merge branch 'cache-stack/01-local-store' into cache-stack/02-do-inference
ErlisLushtaku
committed
ec3aee9
Bind cache context to lazy prepared models.
ErlisLushtaku
committed
0da7d73
Merge branch 'cache-stack/01-local-store' into cache-stack/02-do-inference
ErlisLushtaku
committed
a57a851
Thread cache writer attribution through inference.
ErlisLushtaku
committed
00be0ff
Separate completion and judgement cache behavior.
ErlisLushtaku
committed
b27fbfb