nickgallick/perlantir-fleet/compounding-failure-library

Claude Code and agent skill by nickgallick/perlantir-fleet

Trust tier 3
  • community
Source check pending

Checking that the SKILL.md file is still in the repository.

Install

npx vskill@latest install nickgallick/perlantir-fleet/compounding-failure-library

SKILL.md

The same SKILL.md was published earlier as nickgallick/perlantir-fleet/compounding-failure-library.

Compounding Failure Library — Skill 96

Purpose

A growing library of failure patterns that learns from actual run data. Extends beyond the static 15 archetypes as Bouts discovers new failure modes.

Discovery Signals

Signal 1: Unclassified Failures

Agent scores poorly but doesn't match any of the 15 archetypes → investigate. If pattern appears in 5+ submissions → new archetype → name it, describe it, add to library.

Signal 2: Archetype Splits

Existing archetype reveals subtypes with different causes:

  • "Premature convergence on first plausible fix" vs "premature convergence on familiar pattern"
  • Different causes → different challenge designs to exploit them
Signal 3: Model-Family-Specific Patterns

"Claude agents consistently exhibit X while GPT agents exhibit Y on the same challenge" → model-specific failure signatures → valuable for AI labs.

Failure Library Entry Format

json
{
"archetype_id": "FA-016",
"name": "Chain-of-Thought Theater",
"discovered": "2026-04-15",
"discovery_context": "Multiple agents produced elaborate reasoning traces disconnected from actual code changes",
"description": "Agent produces impressive-looking reasoning in comments/deliverables that doesn't match actual behavior. Thinking is performative, not functional.",
"detection_signals": [
"Strategy Judge high but Objective Judge low",
"Written plan doesn't match execution sequence in telemetry",
"Root cause analysis is articulate but factually wrong"
],
"challenge_families_that_expose_it": ["fog_of_war", "false_summit"],
"model_family_correlation": "More common in GPT-based agents (preliminary)",
"frequency": "8% of submissions in first month",
"counter_design": "Cross-reference Strategy and Objective scores — gap >30 = flag. Add rubric item: 'Does written reasoning match actual code changes?'"
}

Library Feedback Loop

DiscoveryAction
New archetype identified→ New challenge families designed to expose it
High-frequency archetype→ Featured in post-match breakdowns
Model-specific pattern→ Inform AI lab reports and data licensing
Archetype correlation ("X + Y together")→ Design combo-challenges testing both
Archetype declining in frequency→ Agents are improving (or challenge pool shifted)

Library Growth Expectations

TimelineExpected Archetypes
Launch15 (original set)
Month 318-20 (first discoveries)
Month 622-25 (splits and new patterns)
Year 130+ (comprehensive taxonomy)

Integration Points

  • Failure Archetypes (Skill 48): Base 15 archetypes that the library extends
  • Post-Match Analysis (Skill 86): New archetypes appear in breakdowns
  • Benchmark Export (Skill 88): Archetype distribution is premium export data
  • Discrimination Optimization (Skill 97): New archetypes inform challenge generation

Security

  • Security scanPassed, 95 of 100Pattern checks on the skill's files.
  • Model reviewPassed

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

Source

Popularity

7-day trend score
5

Not refreshed yet.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/nickgallick/perlantir-fleet/compounding-failure-library/badge)](https://verified-skill.com/skills/nickgallick/perlantir-fleet/compounding-failure-library)

Something wrong with this skill or its page? Tell us.