Skill v1.0.0
currentAutomated scan100/100name: judge-sim description: Scores a hackathon project 0 to 5 across seven judging dimensions and produces a prioritized fix list for the last hour. Use for pre-submission self-review to surface the weak points judges will attack. when_to_use: | Trigger when the user is about to submit, wants feedback before the final hour, or asks "how would judges score this". Do not invoke before the demo path runs. Apply after demo-coach so the pitch is in place.
version: 1.0 category: judging tags: ['scoring', '7-dimensions', 'feedback'] dependencies: ['demo-coach'] side_effects: ['review'] triggers:
- 'how would judges score'
- 'pre-submission review'
- 'judge this'
- 'what would judges say'
- 'review my submission'
- '评委打分'
- '模拟评审'
- '评审一下'
- '怎么评分'
- '打分'
allowed_tools: [Read, Write, WebFetch] capabilities: [fs_read, fs_write, net, env] audit_waive: ['env.read-token']
judge-sim
Input contract
Required:
repo_root: project root.hackathon/state/plan.json(preferred; uses demo_path and KEEP list).hackathon/state/demo.json(preferred; uses one_liner)
Optional:
time_remaining_minutes: influences the fix priority listHACKATHON_JUDGE_BACKEND: optional HTTP endpoint for an LLM judge; the script POSTs the state inputs and uses the returned scores. Any failure falls back to the heuristic scorer.HACKATHON_JUDGE_TIMEOUT_SECONDS: request timeout for the backend (default 3).
Execution
1. Score seven dimensions
Each dimension: 0 (catastrophic) to 5 (excellent).
| Dimension | What judges look for | |
|---|---|---|
| problem_clarity | Is the pain obvious in 10 seconds? | |
| originality | Is this novel vs. existing solutions? | |
| completeness | Does the demo path actually work? | |
| technical_depth | Is the implementation non-trivial? | |
| demo_quality | Is the pitch tight and rehearsed? | |
| business_value | Would someone pay / use this? | |
| submission_readiness | README, run steps, secret hygiene? |
2. For each dimension, output
score: 0..5deduction_reason: one line why not higherjudge_questions: 2–3 likely questionsimprovements: 1–3 concrete actions
3. Compute fix priorities
Three buckets:
- FIX_NOW: changes that take < 30 min and improve any score
- FIX_LAST_10MIN: cosmetic / typo-level changes only
- DO_NOT_TOUCH: things that look fixable but risk breaking the demo
4. Hard rule
If .hackathon/state/verify.json last status is fail, any dimension scoring above 3 is invalid. Cap them at 3 and explain.
Output contract
Files written:
.hackathon/state/review.json(matchessrc/state/schemas/review.schema.json).hackathon/artifacts/judge-feedback.md(human-readable review)
Acceptance criteria
- [ ] Provides per-dimension score (0-5).
- [ ] Provides deduction_reason per dimension.
- [ ] Provides improvement suggestions per dimension.
- [ ] Distinguishes FIX_NOW / FIX_LAST_10MIN / DO_NOT_TOUCH.
- [ ] Caps dimensions at 3 when verify status is fail.
- [ ] Outputs a single overall score (mean).
Failure modes
| Mode | Behavior | |
|---|---|---|
No demo.json | Refuse; ask to run demo-coach first | |
plan.json missing | Continue, but note "demo not derived from a known plan" | |
| All 7 scores = 5 | Refuse to rubber-stamp; ask the human to challenge one score | |
| All 7 scores = 0 | Refuse to dunk; ask the human to confirm |
Trigger phrases
- "how will judges score us"
- "what will the judges ask"
- "is this competitive"
- "final review before submit"
- "what should I fix"