specula-org/sysmobench/harness-gen

Claude Code and agent skill by specula-org/sysmobench

Trust tier 3
  • community
Source check pending

Checking that the SKILL.md file is still in the repository.

Trace harness generation for SysMoBench. Use when bootstrapping a new task: clone the system into artifacts/<task>/, instrument it to emit NDJSON traces at the task-required granularity, write a run.sh, and produce INSTRUMENTATION.md. One-time work per task; the resulting harness is reused for every spec evaluation via the tv-eval skill.

Install

npx vskill@latest install specula-org/sysmobench/harness-gen

SKILL.md

Read guide.md for the full workflow methodology.

SysMoBench conventions (overrides Specula paths in guide.md)

  • Cloned source lives at artifacts/<task>/ (see artifacts/README.md).
  • The task's prompt at tla_eval/tasks/<task>/prompts/ defines what must be modeled — the harness must emit events for each required behavior at the right granularity.
  • After instrumenting, update tla_eval/tasks/<task>/task.yaml's tv.repo_path to point at the cloned tree, and fill tv.harness (instrumentation_file, test_file, run_command).
  • Trace output goes to artifacts/<task>/traces/ by default (or a path defined by tv.harness.traces_output_env).
  • Downstream consumer: the tv-eval skill will re-run this harness when spec evaluation needs fresh/compliant traces.

Orchestration: bootstrap the 9 missing tasks

If you were handed this skill as part of the SysMoBench harness-bootstrap project, read BOOTSTRAP_9_SYSTEMS.md next — it lists the 9 tasks still needing harnesses, repo reuse hints, ordering, and per-task done-criteria.

Security

  • Security scanPassed, 90 of 100Pattern checks on the skill's files.
  • Model reviewPassed

See the full security report

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

See evaluation results

Source

Popularity

7-day trend score
0

Not refreshed yet.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/specula-org/sysmobench/harness-gen/badge)](https://verified-skill.com/skills/specula-org/sysmobench/harness-gen)

Something wrong with this skill or its page? Tell us.