eval: separate fixture history from declared Git identity - #50
Conversation
agent-session-id: dev3.dotfiles-cos-misc-st2-resource-design agent-tool: Codex agent-tool-version: 0.145.0 agent-model: gpt-5.6-sol agent-runtime-profile: /home/schickling/.local/state/agent-session-recovery/2026-07-29-pty-st2-cutover/runtime-profile/profile-without-null-opencode.json agent-skills-manifest: /nix/store/kx5j47nghj1yps2v693ryb6wnf1c2xhb-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@16a22c6
agent-session-id: dev3.dotfiles-cos-misc-st2-resource-design agent-tool: Codex agent-tool-version: 0.145.0 agent-model: gpt-5.6-sol agent-runtime-profile: /home/schickling/.local/state/agent-session-recovery/2026-07-29-pty-st2-cutover/runtime-profile/profile-without-null-opencode.json agent-skills-manifest: /nix/store/kx5j47nghj1yps2v693ryb6wnf1c2xhb-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@16a22c6
agent-session-id: dev3.dotfiles-cos-misc-st2-resource-design agent-tool: Codex agent-tool-version: 0.145.0 agent-model: gpt-5.6-sol agent-runtime-profile: /home/schickling/.local/state/agent-session-recovery/2026-07-29-pty-st2-cutover/runtime-profile/profile-without-null-opencode.json agent-skills-manifest: /nix/store/kx5j47nghj1yps2v693ryb6wnf1c2xhb-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@16a22c6
agent-session-id: dev3.dotfiles-cos-misc-st2-resource-design agent-tool: Codex agent-tool-version: 0.145.0 agent-model: gpt-5.6-sol agent-runtime-profile: /home/schickling/.local/state/agent-session-recovery/2026-07-29-pty-st2-cutover/runtime-profile/profile-without-null-opencode.json agent-skills-manifest: /nix/store/kx5j47nghj1yps2v693ryb6wnf1c2xhb-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@16a22c6
agent-session-id: dev3.dotfiles-cos-misc-st2-resource-design agent-tool: Codex agent-tool-version: 0.145.0 agent-model: gpt-5.6-sol agent-runtime-profile: /home/schickling/.local/state/agent-session-recovery/2026-07-29-pty-st2-cutover/runtime-profile/profile-without-null-opencode.json agent-skills-manifest: /nix/store/kx5j47nghj1yps2v693ryb6wnf1c2xhb-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@16a22c6
|
Current-main reconciliation found an unresolved runtime identity-input blocker; this draft is not ready to retarget. A clean local five-commit restack onto main Exact cause: Injecting identity only into the free gate would make the proof diverge from the real eval, while embedding a principal identity is not portable. No branch update, model/provider call, or deployment was made. The provisional local restack head is |
e5f2f98 to
684e9fd
Compare
|
Resolved by the accepted fixture-owned identity contract and current-main restack at exact head Weird-Git now pins Focused gates and the complete pinned model-free preflight are green. PR state is draft, cleanly mergeable, and thread-clean. No model/provider call or deployment was made. |
Why
Free gates and runtime materializers were using porcelain commits to construct synthetic history. That conflated deterministic fixture data with an agent-authored commit lifecycle: repository commit policy and hooks could reject the setup or inject private provenance into scanner and oracle inputs.
What
Separate the two boundaries:
Eval Worktree Actor <worktree-actor@eval.invalid>in both worktree-local configs. Its judge dynamically compares the feature commit to that pinned identity.Synthetic roots and mutation inputs now use
write-tree,commit-tree, andupdate-ref, so constructing test data does not invoke authored commit hooks. The signal twins grade onlyBASE..HEAD. Weird-Git excludes its root structurally, retainsextensions.worktreeConfig, and compares the feature tip against its fixture-declared worktree identity.Validation
Restacked on current
maincommit0d5ba20fc5ab28e7e8085cd00070baa9897acf5d.Focused gates are green:
git diff --checkSPEC_DIRidentity is readThe complete pinned model-free preflight exits 0:
9887b28, binary SHA-256d49d44fd4f3f6f655455c212353a469fefa956082bedf22163deb767d8a36a0dNo model/provider call or deployment was made.