Skip to content

Improve/skill review optimization#3156

Open
yogesh-tessl wants to merge 2 commits into
akash-network:mainfrom
yogesh-tessl:improve/skill-review-optimization
Open

Improve/skill review optimization#3156
yogesh-tessl wants to merge 2 commits into
akash-network:mainfrom
yogesh-tessl:improve/skill-review-optimization

Conversation

@yogesh-tessl
Copy link
Copy Markdown

@yogesh-tessl yogesh-tessl commented May 8, 2026

Hey @stalniy 👋

these skills are pretty good. The setup() DI pattern baked into console-tests is honestly a great convention, i like it. and the way you've done progressive disclosure into reference files, keeps the main skill lean but the depth is still there if you need it.

I ran your one of your skill through tessl skill review at work and found targeted improvements in your skill. Here's the before/after:

Skill Before After Change
console-tests 89% 94% +5%

I focused on console-tests because it had the most improvement headroom and is the most central skill. It's the one referenced in your CLAUDE.md as required for all testing work.

Changes made

Conciseness improvements:

  • Replaced the verbose "Deciding What Type of Test to Write" section with a compact decision table - removed explanations of what each test type is (Claude already knows) and kept only your project-specific criteria and mocking strategies
  • Removed generic preamble ("read the source file thoroughly") that doesn't add value for an AI agent
  • Consolidated "Comments Answer WHY, Not WHAT" (generic advice) into the error handling section and tightened the wording

Workflow clarity (biggest impact):

  • Added an "After Writing Tests" verification checklist with 5 concrete steps - npm test, npx tsc --noEmit, npm run lint -- --quiet, review output, verify coverage
  • This was the main judge feedback: the skill lacked explicit validation checkpoints, which is critical for a testing skill

I also stress-tested your console-tests skill against a few real-world task evals and it held up really well on functional tests with white-box DB seeding and nock-based blockchain node mocking. Kudos for that.

Honest disclosure. I work at https://github.com/tesslio where we build tooling around skills like these. Not a pitch - just saw room for improvement and wanted to contribute.

If you want to self-improve your skills, or define your own scenarios to pressure test, just ask your agent (Claude Code, Codex, etc.) to evaluate and optimize your skill with Tessl. Ping me @yogesh-tessl, if you hit any snags.

Summary by CodeRabbit

  • Documentation
    • Updated test-writing guidance with clearer classifications and use-case mappings
    • Refined functional test failure criteria for consistency
    • Focused error-handling coverage guidance
    • Added post-test-writing verification checklist

Hey @stalniy 👋

Really solid set of skills here — the `setup()` function DI pattern baked into `console-tests` is a great convention, and the progressive disclosure to reference files keeps the main skill lean without losing depth.

## Why

I ran your skills through `tessl skill review` at work and found some targeted improvements. Here's the full before/after:

| Skill | Before | After | Change |
|-------|--------|-------|--------|
| console-tests | 89% | 94% | +5% |
| linear-issue | 90% | — | unchanged |
| branch-namer | 90% | — | unchanged |

I focused on `console-tests` because it had the most improvement headroom and is the most central skill — it's the one referenced in your CLAUDE.md as required for all testing work.

## What

<details>
<summary>Changes made</summary>

**Conciseness improvements:**
- Replaced the verbose "Deciding What Type of Test to Write" section with a compact decision table — removed explanations of what each test type is (Claude already knows) and kept only your project-specific criteria and mocking strategies
- Removed generic preamble ("read the source file thoroughly") that doesn't add value for an AI agent
- Consolidated "Comments Answer WHY, Not WHAT" (generic advice) into the error handling section and tightened the wording

**Workflow clarity (biggest impact):**
- Added an "After Writing Tests" verification checklist with 5 concrete steps — `npm test`, `npx tsc --noEmit`, `npm run lint -- --quiet`, review output, verify coverage
- This was the main judge feedback: the skill lacked explicit validation checkpoints, which is critical for a testing skill

**Net result:** 11 fewer lines, tighter content, same domain expertise preserved.

</details>

I also stress-tested your `console-tests` skill against a few real-world task evals and it held up really well on functional tests with whitebox DB seeding and nock-based blockchain node mocking. Kudos for that.

Honest disclosure — I work at @tesslio where we build tooling around skills like these. Not a pitch — just saw room for improvement and wanted to contribute.

Want to self-improve your skills? Just point your agent (Claude Code, Codex, etc.) at [this Tessl guide](https://docs.tessl.io/evaluate/optimize-a-skill-using-best-practices) and ask it to optimize your skill. Ping me — [@yogesh-tessl](https://github.com/yogesh-tessl) — if you hit any snags.

Thanks in advance 🙏
@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented May 8, 2026

Review Change Stack
No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 7fec3d66-f027-44b7-af72-a52e5efb9857

📥 Commits

Reviewing files that changed from the base of the PR and between dad26b7 and 965922e.

📒 Files selected for processing (1)
  • .claude/skills/console-tests/SKILL.md

📝 Walkthrough

Walkthrough

This PR refines the console test-writing skill guide by introducing a structured decision framework for test level selection, narrowing error-path testing guidance to explicitly handled exceptions, and adding a post-writing verification checklist for completeness and correctness.

Changes

Test Guide Improvements

Layer / File(s) Summary
Test Selection Framework
.claude/skills/console-tests/SKILL.md
Introduced a compact level-vs-use-case table (unit, integration, functional, E2E) with mocking strategy rules. Clarified that functional tests should only fail on functional requirement changes, not refactors.
Error Path Testing
.claude/skills/console-tests/SKILL.md
Replaced broader comment and error-handling guidance with a focused section instructing tests to cover error paths the code explicitly handles, especially caught and transformed errors.
Post-Writing Verification
.claude/skills/console-tests/SKILL.md
Added an "After Writing Tests" checklist specifying commands to run (test suite, tsc --noEmit, lint) and review criteria for test output, assertions, and coverage relevance.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~3 minutes

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Tip

💬 Introducing Slack Agent: The best way for teams to turn conversations into code.

Slack Agent is built on CodeRabbit's deep understanding of your code, so your team can collaborate across the entire SDLC without losing context.

  • Generate code and open pull requests
  • Plan features and break down work
  • Investigate incidents and troubleshoot customer tickets together
  • Automate recurring tasks and respond to alerts with triggers
  • Summarize progress and report instantly

Built for teams:

  • Shared memory across your entire org—no repeating context
  • Per-thread sandboxes to safely plan and execute work
  • Governance built-in—scoped access, auditability, and budget controls

One agent for your entire SDLC. Right inside Slack.

👉 Get started


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@stalniy stalniy requested a review from baktun14 May 8, 2026 09:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant