aiming-lab/autoresearchclaw/statistical-experimental-evaluation

Claude Code and agent skill by aiming-lab/autoresearchclaw

Trust tier 3
  • community
Source check pending

Checking that the SKILL.md file is still in the repository.

Design and run statistical experiments that test the formal problem, proposed methods, theoretical predictions, baselines, and ablations.

Install

npx vskill@latest install aiming-lab/autoresearchclaw/statistical-experimental-evaluation

SKILL.md

Statistical Experimental Evaluation

Overview

Use this skill after formulation, method proposal, and theory. Experiments should test specific claims and theoretical predictions.

Experiment Plan

Define:

  • Conditions or data-generating processes
  • Real data source or synthetic data generator
  • Sample sizes, folds, repetitions, seeds, or resamples
  • Proposed method
  • Baselines
  • Ablations
  • Diagnostics
  • Metrics
  • Failure accounting

Required Artifacts

text
experiments/<TOPIC_ID>/config.yaml
experiments/<TOPIC_ID>/src/
experiments/<TOPIC_ID>/results/metrics.json
experiments/<TOPIC_ID>/results/run_manifest.json
experiments/<TOPIC_ID>/results/comparison_summary.md
experiments/<TOPIC_ID>/results/claim_verdicts.json
experiments/<TOPIC_ID>/report/paper.md
experiments/<TOPIC_ID>/README.md

Evidence Schema

Use a row-oriented metric format:

json
{
  "topic_id": "TXX",
  "metric_rows": [
    {
      "claim_id": "C1",
      "method": "proposed_method",
      "baseline": "standard_method",
      "condition": "stress_condition",
      "metric": "risk",
      "value": 0.12,
      "status": "ok"
    }
  ]
}

Claim verdicts should connect theory and experiments:

json
[
  {
    "claim_id": "C1",
    "verdict": "supported",
    "theory_support": "Proposition 1 under A1-A3",
    "experimental_support": "Proposed method has lower risk in conditions X-Y",
    "comparison": "Outperforms baseline B on metric M",
    "limitations": "Finite sample only; assumption A2 not tested"
  }
]

Evidence Rules

  • A metric must map to a formulated claim.
  • A comparison must use the same data conditions across methods.
  • Failed runs must be counted.
  • Runtime reductions must be recorded.
  • Results must be interpreted against theoretical predictions.

Security

  • Security scanPassed, 90 of 100Pattern checks on the skill's files.
  • Model reviewPassed

See the full security report

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

See evaluation results

Source

Popularity

Repository stars
13,869
Repository forks
1,628
7-day trend score
48

Stars and forks are for the whole GitHub repository, not this skill alone. Not refreshed yet.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/aiming-lab/autoresearchclaw/statistical-experimental-evaluation/badge)](https://verified-skill.com/skills/aiming-lab/autoresearchclaw/statistical-experimental-evaluation)

Something wrong with this skill or its page? Tell us.