Test a skill in Skill Studio

Test a skill in Skill Studio.

This sample repo has one skill, `commit-message`, and its test file. Start Skill Studio in the repo with `npx vskill studio`. It runs on this machine, at a localhost address.

Pick the skill in the sidebar, then open Tests. The test is a real task: write a commit message for this diff. Four checks in plain English say what a good answer looks like.

Choose the model that runs the test. Here, Claude Opus 4.8 through the Anthropic API.

On Run, click Run A/B Test. Studio answers the task twice: with the skill, and without it. The same model then checks both answers against every assertion.

With the skill, all four checks pass. Without it, two of four. A blind comparison of the two answers also preferred the skill. Results vary between runs, so run it again before you change the skill.

Next: read the Skill Studio docs.

The narration as voiced in the video.