mcorbett51090/ravenclaude/ab-test-plumbing
Claude Code and agent skill by mcorbett51090/ravenclaude
- community
Checking that the SKILL.md file is still in the repository.
Build trustworthy A/B-test plumbing: deterministic sticky assignment, exposure logging (who actually saw the variant), Sample-Ratio-Mismatch checks before reading results, pre-registered metric/MDE/duration, and guardrail metrics — leaving significance to applied-statistics.
Install
npx vskill@latest install mcorbett51090/ravenclaude/ab-test-plumbingSKILL.md
The same SKILL.md was published earlier as mcorbett51090/ravenclaude/ab-test-plumbing.
A/B Test Plumbing
Plumbing before result
- Deterministic, sticky assignment (hash-based per unit).
- Log exposure (who SAW the variant), not just assignment.
- SRM check: observed split != intended -> assignment is broken -> result invalid (no matter how significant).
Pre-register (with applied-statistics)
Primary metric, MDE, duration, guardrails — set before start. No peeking-to-stop, no HARKing.
Guardrails
A winning primary metric that tanks latency/errors/revenue is not a win.
Hand off
Deliver clean exposure + metric data; significance is applied-statistics'.
Security
- Security scanPassed, 100 of 100Pattern checks on the skill's files.
- Model reviewNot runA model review is scheduled for the next rescan.
Quality evaluation
- Task evaluationNot runNo evaluation yet. Run one in Skill Studio.
Source
- SKILL.md in the repositoryCheckingplugins/experimentation-growth-engineering/skills/ab-test-plumbing/SKILL.md
Popularity
- Repository stars
- 7
- Repository forks
- 1
- 7-day trend score
- 15
Stars and forks are for the whole GitHub repository, not this skill alone. Not refreshed yet.
Works with
Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.
- Claude Code
- Cursor
- GitHub Copilot
- Windsurf
- Codex
- Gemini CLI
- Cline
- Amp
- Roo Code
- Goose
- Continue
- Kilo Code
- Junie
- Trae
- OpenHands
- Qwen Code
- AI Agent
- Tabnine Chat
- Sourcegraph Cody
- Amazon Q
- Firebase Genkit
- Sweep
- Devin
- Phind
- Mentat
- Claude Desktop
- Aider
- GPT Pilot
- Plandex
- bolt.new
- v0
- Replit Agent
- Anse
- TypingMind
- BetterChatGPT
- LibreChat
- Warp AI
- Pieces
- Fig AI
Embed badge
[](https://verified-skill.com/skills/mcorbett51090/ravenclaude/ab-test-plumbing)