Skip to content

Add rigorous local model benchmark evidence#3

Merged
alan-d-smith merged 1 commit into
mainfrom
codex/phi-local-benchmark
Jul 12, 2026
Merged

Add rigorous local model benchmark evidence#3
alan-d-smith merged 1 commit into
mainfrom
codex/phi-local-benchmark

Conversation

@alan-d-smith

Copy link
Copy Markdown
Member

Summary

  • resolve memory/CPU metrics from the worker's actual nested cgroup
  • record CPU quota, period, derived quota cores, and effective cpuset
  • add repeatable --task-kind filtering and a balanced 40-case sentiment stress corpus
  • document the evidence-based rejection of all tested Phi GGUF routes
  • refresh both reproducibility manifests without consuming sealed holdout-v2

No local weights, llama.cpp runtime dependency, production route, or container change is included.

Verification

  • 579 tests passed, 1 Windows symlink skip
  • Ruff check and format check passed
  • strict mypy passed across 72 source files
  • Python 3.10 source compilation passed
  • track1-v1 and track1-v2 manifests verify

@alan-d-smith
alan-d-smith merged commit ea40ce9 into main Jul 12, 2026
2 checks passed
@alan-d-smith
alan-d-smith deleted the codex/phi-local-benchmark branch July 12, 2026 08:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant