tiger-ai-lab/rewardharness/mitigate-positional-bias

Claude Code and agent skill by tiger-ai-lab/rewardharness

Trust tier 2
  • community
LLM review pending
Source check pending

Checking that the SKILL.md file is still in the repository.

Strategies to prevent defaulting to Image B and ensure fair evaluation

Install

npx vskill@latest install tiger-ai-lab/rewardharness/mitigate-positional-bias

SKILL.md

Mitigate Positional Bias

There is a strong observed bias towards predicting Image B as the winner, especially when both images have flaws or when the evaluation is difficult.

  1. Evaluate A First: Always explicitly evaluate Image A's adherence to the instruction and visual quality before looking at Image B.
  2. Fair Comparison: Do not overlook Image A's successes just because Image B looks slightly more polished. If Image A followed the instruction and Image B did not, Image A must win, regardless of minor artifacts.
  3. Justify B over A: If you choose B, ensure you have a concrete, visually verified reason why A failed or was inferior. Do not use vague terms like "more natural" to justify B if A actually followed the instruction better.

<!-- Release review: RewardHarness v0.4.1 (2026-08-26). -->

Security

  • Security scanPassed, 100 of 100Pattern checks on the skill's files.
  • Model reviewNot runA model review is scheduled for the next rescan.

See the full security report

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

See evaluation results

Source

Popularity

Repository stars
79
Repository forks
9
7-day trend score
0

Stars and forks are for the whole GitHub repository, not this skill alone. Not refreshed yet.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/tiger-ai-lab/rewardharness/mitigate-positional-bias/badge)](https://verified-skill.com/skills/tiger-ai-lab/rewardharness/mitigate-positional-bias)

Something wrong with this skill or its page? Tell us.