<< All versions

Skill v1.0.0

currentAutomated scan100/100
sdsrss/agentsmd/agentsmd-lesson-bypass-audit
──Details
PublishedOctober 3, 2026 at 04:08 PM
Content Hashsha256:85961027202f0ad8...
Git SHA
──Files
Files (1 file, 1.8 KB)
SKILL.md1.8 KBactive
SKILL.md · 31 lines · 1.8 KB

version: "1.0.0" name: agentsmd-lesson-bypass-audit description: Measure whether surfaced memory hints were later cited in Codex transcripts. Use for memory hint follow-through and bypass rates. Not for rule-hit governance or memory editing; read-only.


agentsmd-lesson-bypass-audit

Use the selected SKILL.md absolute path from the live skills list; never infer it from the process cwd. Define and call the adjacent launcher in the same shell. The launcher preserves selected bundle → manifest-owned standalone → versioned CLI identity checks and exports plugin context only for a verified selected bundle.

bash
SKILL_MD="<selected SKILL.md absolute path from the live skills list>"
agentsmd_skill_run() {
node "$(dirname "$SKILL_MD")/scripts/agentsmd-run.js" "$SKILL_MD" "$@"
}

memory-prompt-hint.sh records a suggest event with the memory files it surfaced. A hint is a relevance candidate, not a requirement to read every suggested file; §7 requires consultation when the task actually matches the memory. This audit asks whether a non-user transcript row named a suggested file after the hint. A mention proves neither a successful read nor semantic relevance.

  • applied — a suggested file is named by a non-user transcript row after the hint.
  • bypassed — transcript found, no such reference.
  • unmeasurable — no transcript for that session (surfaced separately so the % isn't overclaimed).

Run:

bash
agentsmd_skill_run --days=30

Report cite-recall = applied / (applied + bypassed) plus the unmeasurable slice. A low recall means the hint is firing but being bypassed — uncited memory decays, so this is the signal that the memory layer needs tuning (better index keywords, fewer/stronger hints). Advisory only. From the repo instead of an install: node scripts/lesson-bypass-audit.js.

All versions