Skip to content

blog: portable agent skills need runtime budget tests - #1004

Merged
amavashev merged 1 commit into
mainfrom
blog/portable-agent-skills-budget-tests
Oct 23, 2026
Merged

amavashev merged 1 commit into
mainfrom
blog/portable-agent-skills-budget-tests

Conversation

@amavashev

Copy link
Copy Markdown
Contributor

Summary

A skill can move from a CLI to a cloud worker while accidentally receiving a fresh task allowance. Add Portable Agent Skills Need Runtime Budget Tests, explaining how to verify shared task identity, admission, and accounting across execution adapters.

The article uses the October 22 Agent Skills foundation donation as its news hook, acknowledges platform-native controls, and provides five deployment acceptance tests. A downloadable Python drill exercises handoff, concurrent reservations, and a deliberately broken scope mapping against real Cycles ledgers. Its adapters and tool calls are simulated; it explicitly does not certify vendor-runtime compatibility.

Sources include the Agent Skills specification, primary announcements, and pinned Cycles protocol YAML. The article is 1,754 words, with a 47-character title and 158-character description.

Checklist

  • Tests added/updated for new behavior — self-checking executable drill, plus local live and failure-path validation
  • AUDIT.md updated (if protocol surface changed) — not applicable; no protocol change
  • README.md updated (if public API changed) — not applicable; no public API change
  • Local documentation build and focused validation passed

Test plan

  • Live drill against Cycles runtime 0.1.25.59 and Admin 0.1.25.55 in an isolated disposable stack: handoff and concurrent admission each allowed one $0.06 operation against a $0.10 task. Negative control detected $0.12 aggregate spend across two incorrectly separated scopes.
  • Repeated with exactly $0.24 tenant capacity: passed. With $0.23999999: failed as expected at the final admission.
  • Eight failure-path checks covered HTTP 503, unsupported caps, incorrect scope, expired/missing TTL, transport failure, settlement failure without redispatch, and barrier abort.
  • npm run build passed, including PDF generation. Verified rendered metadata, four tables, and both download links; served script matched source.
  • All 13 unique link targets verified; glossary linking and whitespace checks passed.
  • Three internal review passes and one independent Codex review across all eight quality dimensions: SHIP, no findings. Final internal score: 9.3/10.

Review changes: applied shorter SEO description and tested-version details; no rejected findings. Restart, alternate-route, and deployed-runtime outage tests remain explicitly application-specific acceptance work.

Add a sourced article and a reproducible drill for task-budget handoff,
concurrent admission, and detecting incorrect runtime-to-scope mapping.
Keep simulated adapters distinct from vendor-runtime certification.

Review decisions:
- Apply: tighten SEO description and identify tested runtime/Admin versions.
- Modify: none.
- Skip: none.
Independent Codex review: SHIP; no findings across all eight dimensions.

Validation: live Cycles drill, exact-capacity and insufficient-capacity
checks, eight failure-path checks, full site build, rendered-page and
script download verification.
@amavashev
amavashev merged commit 8af2b30 into main Oct 23, 2026
8 checks passed
@amavashev
amavashev deleted the blog/portable-agent-skills-budget-tests branch October 23, 2026 13:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant