Skip to content

Add rigorous route promotion evidence#2

Merged
alan-d-smith merged 1 commit into
mainfrom
codex/measurement-rigor
Jul 12, 2026
Merged

Add rigorous route promotion evidence#2
alan-d-smith merged 1 commit into
mainfrom
codex/measurement-rigor

Conversation

@alan-d-smith

Copy link
Copy Markdown
Member

Summary

  • add manifest-locked paired route comparison with uncertainty and fail-closed evidence gates
  • record consumed v1 and independently authored/reviewed sealed v2 holdouts
  • document source-bound Kimi/MiniMax evidence and the rejected logic/local-model experiments

Verification

  • 569 passed, 1 Windows symlink skip
  • Ruff check and format clean
  • strict mypy clean across 72 source files
  • Python 3.10 syntax compile clean in WSL
  • both measurement manifests verify

Runtime impact

No scored routing or container behavior changes. The existing public image remains the current evidence-backed baseline; the new sealed holdout is reserved for the consequential exact Gemma/Kimi comparison.

@alan-d-smith
alan-d-smith merged commit 39667d5 into main Jul 12, 2026
2 checks passed
@alan-d-smith
alan-d-smith deleted the codex/measurement-rigor branch July 12, 2026 01:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant