tongminglaic/ako4x/benchmark
Claude Code and agent skill by tongminglaic/ako4x
- community
Checking that the SKILL.md file is still in the repository.
Reference for the active benchmark harness — what it IS and how it behaves (the active benchmark is flashinfer-bench). Covers config.toml structure (`[solution]`/`[build]`/`[benchmark]` tables), the status enum, the workload / fresh-inputs model, reference-baseline + scoring mechanics, tolerance keys, TVM-FFI builder link limits, and the silent-skip cascade. Invoke whenever you decode a bench status string, hit an unfamiliar config.toml field, suspect "correctness passed but the headline is implausible", or need to know what's frozen before proposing a bench edit — do NOT guess field or status semantics. Bench commands and noise methodology (A/B compare, variance check, drift cancellation) live in the `bench` skill.
Install
npx vskill@latest install tongminglaic/ako4x/benchmarkSKILL.md
Benchmark
The active benchmark harness — what this project's bench skill is a frontend for. Reference for what the benchmark is and how it behaves — distinct from the bench skill which covers how to drive it from the harness shim. The active benchmark is flashinfer-bench; this skill is the single home for its schema, status, scoring, and frozen-for-comparability behavior. Detailed body: benchmark.md.
When this skill applies:
- Looking up a
config.tomlfield you don't recognize. - Decoding a status string from bench output (
COMPILE_ERROR,INCORRECT_NUMERICAL, etc.). - Reasoning about why correctness "passed" but the headline looks too good (silent-skip cascade ends here).
- Checking what's frozen for bench comparability (scoring/baseline/tolerance) before proposing a harness edit.
- Understanding the TVM-FFI link limit for C++/CUDA (no compile-time linking) and which kernel libraries are disallowed (cuBLAS / cuDNN) vs. allowed building blocks (CUTLASS, the DSLs) — see "Valid solution: write your own kernel".
Security
- Security scanPassed, 95 of 100Pattern checks on the skill's files.
- Model reviewPassed
Quality evaluation
- Task evaluationNot runNo evaluation yet. Run one in Skill Studio.
Source
- SKILL.md in the repositoryCheckingtemplates/skills/benchmark/SKILL.md
Popularity
- Repository stars
- 74
- Repository forks
- 13
- 7-day trend score
- 22
Stars and forks are for the whole GitHub repository, not this skill alone. Not refreshed yet.
Works with
Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.
- Claude Code
- Cursor
- GitHub Copilot
- Windsurf
- Codex
- Gemini CLI
- Cline
- Amp
- Roo Code
- Goose
- Continue
- Kilo Code
- Junie
- Trae
- OpenHands
- Qwen Code
- AI Agent
- Tabnine Chat
- Sourcegraph Cody
- Amazon Q
- Firebase Genkit
- Sweep
- Devin
- Phind
- Mentat
- Claude Desktop
- Aider
- GPT Pilot
- Plandex
- bolt.new
- v0
- Replit Agent
- Anse
- TypingMind
- BetterChatGPT
- LibreChat
- Warp AI
- Pieces
- Fig AI
Embed badge
[](https://verified-skill.com/skills/tongminglaic/ako4x/benchmark)