Skip to content

ci: retain execution across failed runs and retries - #709

Merged
ty-everett merged 2 commits into
mainfrom
codex/ci-execution-ledger
Sep 30, 2026
Merged

ty-everett merged 2 commits into
mainfrom
codex/ci-execution-ledger

Conversation

@ty-everett

@ty-everett ty-everett commented Sep 30, 2026 •

Copy link
Copy Markdown
Collaborator

Program and scope

  • Tracker: BotBoard708, following merged prerequisite gate705.
  • Problem: successful-only latency collection omits failed/cancelled campaigns and prior attempts. The preserved failed674 API sample contains1,144.92 mutation runner-minutes invisible to that sample selection; these are execution, not billed cost.
  • Change: collect a separate bounded recent20-PR-run ledger across all outcomes/every attempt, retaining identities, job/step durations and incomplete evidence explicitly. Preserve the original successful-head latency ratchet and baseline independently, including collection failure paths.
  • Exact head: 3d6ea3d; base3e41d6a220783b268b6240ae654f27628c4af557.
  • Out of scope: qualification/coverage/mutation thresholds, selected sources/tests, runtime packages, paid runners, active runs, branch protection and dependency remediation. Ty explicitly requested adminmerge of this reviewed accounting change with the inherited audit failure documented; no dependency fix, suppression or protection change.

Impact

  • No public package source or manifest changed
  • Infrastructure configuration changed (existing weekly trend collection/artifact only)
  • Documentation changed
  • No public package version/release impact; CI-performance reference1.3.2.

Verification

  • Node24.18.0/pnpm10.33.2; frozen offline install with scripts disabled and existing audited esbuild rebuild.
  • pnpm health:check:253/253 script tests, zero control errors; maintenance notices retained.
  • pnpm lint, pnpm format:check, pnpm build:property, pnpm typecheck:pass.
  • Focused accounting/latency tests18/18 pass. Covers all outcomes/attempts, same-head distinct runs, multi-page jobs, duplicate/conflicting identities, cross-attempt evidence, partial/missing timing, skipped/negative spans, bounded history and independent baseline survival after ledger failure.
  • actionlint1.7.12 and git diff --check:pass.
  • Actual saved failed-run evidence reproduces1,144.92 mutation minutes/71 jobs. Bounded live read-only validation of two recent PR runs also passed; no CI run dispatched.
  • Independent internal review found four accounting edge cases, all fixed with regressions; final independent review reports no residual actionable findings.
  • Complete diff self-reviewed
  • All exact-head hosted checks terminal successful (monitoring after publication; no complete qualification claim)

Security and dependencies

  • No dependency/lockfile change or new suppression/skipped test
  • Existing workflow permissions stay actions:read/contents:read; no new credential or mutation permission
  • Conflicting/partial API evidence fails collection. Both independent reports are preserved where available; new accounting errors cannot prevent the existing latency evaluation. Bounds20 runs/10 attempts/1000 jobs per attempt are explicit.
  • Missing/unfinished durations remain unknown; sums are lower bounds. Queue/billing/cancellation reason/selected source union are not invented. A skipped job is never treated as qualified coverage.

Dependency evidence

Not applicable.

Release and operations

  • No publication or deployment performed
  • Operator semantics documented; existing90-day artifact retention unchanged
  • Ledger is additive; successful-run baseline JSON and budget math are unchanged. Ty explicitly authorizes immediate adminmerge of this exact reviewed accounting change despite the inherited dependency audit failure.

Completion evidence

  • Local implementation and independent review complete
  • Exact-head hosted qualification complete
  • Peer702/703 source/workflows/runs untouched; accounting paths have no current scope overlap

Exact-head hosted status and authorized merge exception

At3d6ea3da: Sonar zero-new-findings, both CodeQL analyses, Dependency Review, repository health, docs and conformance checks passed. The build stopped at unchanged root pnpm audit:security on three high advisories: brace-expansion GHSA-qhr7-859c-m2p7 / GHSA-6j4f-fj2g-mc7p and engine.io GHSA-2gc4-cqfq-p2gv. Manifest, workspace and lockfile blobs are identical to main3e41d6a. Downstream mutation/build-and-test/merge gates fail closed; there is no complete green qualification claim. No open review threads. All own new Sonar findings were fixed without suppression and independently reviewed. Ty explicitly instructed merging as-is and handling dependencies later. No gate, branch protection, audit suppression or active-run change.

@sonarqubecloud

Copy link
Copy Markdown

@ty-everett
ty-everett marked this pull request as ready for review September 30, 2026 22:59
@ty-everett
ty-everett merged commit 69879c3 into main Sep 30, 2026
31 of 35 checks passed
@ty-everett
ty-everett deleted the codex/ci-execution-ledger branch September 30, 2026 23:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant