feat: Improve quality of rpi-agent.agent.md#1949
Conversation
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1949 +/- ##
==========================================
- Coverage 80.82% 80.82% -0.01%
==========================================
Files 117 117
Lines 19095 19100 +5
==========================================
+ Hits 15433 15437 +4
- Misses 3662 3663 +1
Flags with carried forward coverage won't be shown. Click here to find out more. 🚀 New features to boost your workflow:
|
bindsi
left a comment
There was a problem hiding this comment.
Approved: the RPI agent guidance cleanup is consistent with the surrounding terminology and documentation patterns. No actionable issues found.
katriendg
left a comment
There was a problem hiding this comment.
Good refactoring that achieves its readability goal with a net -71 lines. The terminology normalization, Execution Model table, and Tracking Artifacts table are all clear improvements.
Requesting changes for one required edit (RI-4: missing explicit simple/medium bullet in Phase 1 Step 1) and two recommended fixes where semantic content was lost during compression (RI-1: Review Log content, RI-2: Iterate/Escalate display guidance).
Priority order:
- RI-4 — Required: restore explicit simple/medium bullet in Phase 1 Step 1
- RI-1 — Recommended: restore Review Log content specification
- RI-2 — Recommended: add display guidance to Iterate/Escalate bullets
- RI-3 — Non-blocking: abstraction tradeoff observation
|
|
||
| | Phase | Direct (Simple/Medium) | Artifact-backed (Medium-hard/Challenging) | | ||
| |-------------------------|---------------------------------------------------------|------------------------------------------------------------------------------------------------------------| | ||
| | Research | Investigate in-context; no research files or subagents | Create research documents; use `Researcher Subagent` selectively (medium-hard) or as default (challenging) | | ||
| | Plan | Record requests, order, and approach in working context | Create plan artifacts in `.copilot-tracking/plans/`; use subagents for especially complex planning | | ||
| | Implement | Execute directly from in-context plan | Execute from plan artifacts; use `Phase Implementor` selectively (medium-hard) or as default (challenging) | | ||
| | Track (Phase 3, Step 4) | Keep internal record of changes and validation | Update all `.copilot-tracking/` artifacts (plan checkboxes, changes log, planning log) | | ||
| | Review | Keep findings in working context | Compile review log in `.copilot-tracking/reviews/` | | ||
|
|
||
| ### Intent Detection | ||
|
|
There was a problem hiding this comment.
Non-blocking observation: abstraction tradeoff
The "Under the direct model..." / "Under the artifact-backed model..." phrasing throughout the phases requires the agent to cross-reference the Execution Model by Phase table at every decision point. The original was more verbose but self-contained at each step.
This is a reasonable tradeoff for maintainability and reduced line count — just flagging it in case testing reveals degraded agent behavior at inference time due to the indirection. No change required unless functional regression is observed.
There was a problem hiding this comment.
This is a good observation. I used the prompt-tester to test the new agent file against couple scenarios.
Input: "Fix a typo in README.md"
Expected: Agent stays in direct model, creates no artifacts, invokes no subagents.
Result: Pass. All 5 phases resolved cleanly to the direct path. The difficulty classification acted as a persistent gate with zero pull toward over-delegation
Input: "Rename validate:frontmatter to lint:frontmatter" (initially medium, reveals 14 cross-cutting references + CI impact during research)
Expected: Agent upgrades from medium to medium-hard mid-Phase 1 and consistently follows artifact-backed path for all subsequent branch points.
Result: Pass (11/12 branch points clean, 1 with moderate tension). The upgrade trigger ("immediately" + "before continuing") is unambiguous. Post-upgrade branch points are stateless and resolve correctly regardless of when the classification changed.
Through this testing, one vulnerability identified: Phase 2 Step 2's "Choose the lightest planning mechanism" phrasing introduces a cognitive backdoor where an upgraded agent could rationalize skipping artifacts despite being in artifact-backed mode. I think it should be fixed to Choose the planning mechanism matching the current execution model that still gives the implementation phase enough structure.
What are your thoughts on updating the identified vulnerability?
There was a problem hiding this comment.
I think my comment was more about the cross referencing back to the table summarizing all file locations within their phases, where now you have the single table summarizing all, and this requires a phase to cross-reference the table again for identifying where to store artifacts.
In the previous version, the phase and type (like subagent) sections each contained their output locations, now it will require the agent to re-read the table and infer the artifact location, then continue on the phase it's at. I'm really not sure this is going to provide the intended optimization. That is the main concern.
bindsi
left a comment
There was a problem hiding this comment.
Approved: the RPI agent refactor preserves the intended guidance while improving readability and consistency. I did not find actionable schema or artifact issues in the current head.
Pull Request
Description
Refactors verbose wording in the RPI Agent instructions while preserving the same workflow rigor and behavior. This change tightens repeated guidance across the agent file, especially around validation and discovery, so the instructions are easier to maintain and read without changing when or how the agent performs Research, Plan, Implement, Review, or Discover phases.
Following updates have been made:
Related Issue(s)
Fixes #1939
Type of Change
Select all that apply:
Code & Documentation:
Infrastructure & Configuration:
AI Artifacts:
prompt-builderagent and addressed all feedback.github/instructions/*.instructions.md).github/prompts/*.prompt.md).github/agents/*.agent.md).github/skills/*/SKILL.md)Other:
.ps1,.sh,.py)Sample Prompts (for AI Artifact Contributions)
User Request:
Execution Flow:
Output Artifacts:
Success Indicators:
For detailed contribution requirements, see:
Testing
Checklist
Required Checks
AI Artifact Contributions
/prompt-analyzeto review contributionprompt-builderreviewRequired Automated Checks
The following validation commands must pass before merging:
npm run lint:mdnpm run spell-checknpm run lint:frontmatternpm run validate:skillsnpm run lint:md-linksnpm run lint:psnpm run plugin:generatenpm run docs:testSecurity Considerations
Additional Notes
This update is not intended to change the behavior of the agent - only to improve readability and quality.