Skip to content

standalone-indexer (h24 line): hash image blocks with their image id again - #46

Draft
Shang-Pin wants to merge 1 commit into
v41-partial-skip-h24from
mm-aware-hash-h24
Draft

Shang-Pin wants to merge 1 commit into
v41-partial-skip-h24from
mm-aware-hash-h24

Conversation

@Shang-Pin

Copy link
Copy Markdown

Reverts #44; same change as #45 on the h24 line. The h24 flavor takes its tokens hashes from the same listener normalizer.

Validation: cargo test -p dynamo-kv-router --features kube-discovery --lib: 614 passed (one run hit the timing-sensitive test_approx_ttl_expiry_removes_match::variant_4 (concurrent); it passed 5/5 reruns and the full suite passed on rerun).

Roll out together with #45 and deepinfra/backend#5428.

🤖 Generated with Claude Code

Reverts "standalone-indexer: hash image blocks from tokens only" (#43).

Token-only image hashing merges blocks of different images at the same
position into one tree edge. The compressed radix tree keeps one engine
block hash per edge position (edge_index), so the second chain's hashes are
only added to the worker lookup, resolve_lookup rejects them, and every
later store of that conversation fails with ParentBlockNotFound: a steady
100-160/min on deepseek-ai/DeepSeek-V4.1-Flash reality and routing, all
traced to image-bearing stores in a live capture. It also lets a query match
a different image's path.

deepapi's KV probe now computes vLLM's image id and mixes it into image
blocks the same way (deepinfra/backend#5428), so the indexer can key image
blocks by content again. The two must roll out together.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@Shang-Pin
Shang-Pin deployed to external_collaborator September 23, 2026 17:49 — with GitHub Actions Active
@github-actions github-actions Bot added the documentation Improvements or additions to documentation label Sep 23, 2026

This branch was successfully deployed

1 active deployment
external_collaborator — 64f616b9 Deployed Sep 23, 2026 by Shang-Pin via ok-to-test #50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant