leadgrowgtm/dev-skills/evals

Claude Code and agent skill by leadgrowgtm/dev-skills

Trust tier 3
  • community
Source check pending

Checking that the SKILL.md file is still in the repository.

Write and run evals, and hill-climb skills and prompts against them. Use when the user wants evals or test cases for a prompt, agent, skill or plugin, asks whether a change made it better or worse, wants to measure how often a skill triggers or which skill fires on which phrasing, wants to mine real phrasing from session logs into test cases, or wants to tune (hill-climb) a skill description or prompt against a held-out set. Covers claude plugin eval cases, graders, cost and CI.

Install

npx vskill@latest install leadgrowgtm/dev-skills/evals

SKILL.md

evals

Pick the job, read its reference.

JobRead
Write or run claude plugin eval cases and gradersreferences/plugin-eval.md
Turn session logs into test casesreferences/mining.md
Tune skill descriptions against the casesreferences/hillclimb.md
Write or fix a skill description, a skill body, a reference file, or an agent-facing docreferences/writing-for-agents.md

Scripts in this skill's directory (stdlib Python, take --plugin DIR): scripts/new_case.py (one confusion-matrix case), scripts/mine.py (logs to candidates), scripts/propose.py (candidates to proposed cases), scripts/make_cases.py (reviewed proposals to cases), scripts/climb.py (tune descriptions; report checks a result against thresholds).

Rules every time:

  • Hold out 40% of cases (the split is fixed by slug hash) and judge only on hold.
  • Trigger tests run with --ablation none; a no-plugin baseline means nothing there.
  • Say the spend before running a paid pass, and pass --max-cost-usd.
  • Mined cases are reviewed by a human before commit; raw logs never leave the machine.

Security

  • Security scanPassed, 90 of 100Pattern checks on the skill's files.
  • Model reviewPassed

See the full security report

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

See evaluation results

Source

Popularity

7-day trend score
0

Not refreshed yet.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/leadgrowgtm/dev-skills/evals/badge)](https://verified-skill.com/skills/leadgrowgtm/dev-skills/evals)

Something wrong with this skill or its page? Tell us.