miaodx/talos/repro-harness

Status: v0 scaffold — unverified. End-to-end behavior not yet validated in

this repo. See `../../STATUS.md`.

repro-harness

Reproduce the idea in the smallest faithful setting and make "did it reproduce" a scalar, so you trust it before touching production code.

Steps

1. Stand up a frozen evaluator (L2) for the minimal reproduction — one scalar +

hard-constraint vetoes (see `../../constraints/`).

1. Implement the minimal repro in an isolated workspace (not your codebase).
2. Verify executability with sampling/smoke unit tests; run in a **fresh,

isolated environment** (sandbox/container) so results cannot be hardcoded or leak state. See `../../docs/survey/safety-sandboxing.md`.

1. Score against a pass/fail rubric (the PaperBench idea): a weighted set of

checks reduced to one number, so reproduction success is comparable.

1. Record the verdict and the frozen evaluator for graft-change to reuse.

Output

A green/red reproduction verdict, plus a frozen evaluator the validation loop can reuse. If it does not reproduce, stop — do not graft an unconfirmed idea.

Notes

• Reproduction failure is information: often an implicit detail (seed, normalization,

data split) the paper omitted — recover it via distill-paper's lineage step.