nameless0120/helloagents-trip-planner/trip-planner-eval-compare

Claude Code and agent skill by nameless0120/helloagents-trip-planner

Trust tier 2
  • community
LLM review pending
Source check pending

Checking that the SKILL.md file is still in the repository.

当用户要运行或对比 helloagents-trip-planner 的 Planner standard/hard 评测时使用；覆盖单模型评测、规则指标、切片汇总、可选 judge 和报告整理。

Install

npx vskill@latest install nameless0120/helloagents-trip-planner/trip-planner-eval-compare

SKILL.md

Trip Planner Eval Compare

这个 skill 只处理模型评测和对比，不负责 SFT 数据生成或训练。评测输入固定使用：

text
training/data/planner/eval/records.jsonl
training/data/planner/eval_hard/records.jsonl

当前流程

text
冻结 records
  -> 模型服务生成
  -> eval_rule_metrics.py
  -> standard / hard 汇总
  -> 切片或 judge（按需）

硬规则

  • 对比模型必须使用同一个 split、同一份 records 和同一套评测脚本。
  • 模型输出写入 training/outputs/eval/<run>/ 本地目录。
  • 先检查生成失败、截断、schema 分母，再解释 hard/soft 指标。
  • LLM judge 需要先确认 API、并发和成本边界。
  • 没有模型服务时先用 --dry-run 检查命令。

具体命令见 references/run_eval.md 和 references/compare_and_report.md。

Security

  • Security scanPassed, 100 of 100Pattern checks on the skill's files.
  • Model reviewNot runA model review is scheduled for the next rescan.

See the full security report

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

See evaluation results

Source

Popularity

Repository stars
141
Repository forks
20
7-day trend score
25

Stars and forks are for the whole GitHub repository, not this skill alone. Not refreshed yet.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/nameless0120/helloagents-trip-planner/trip-planner-eval-compare/badge)](https://verified-skill.com/skills/nameless0120/helloagents-trip-planner/trip-planner-eval-compare)

Something wrong with this skill or its page? Tell us.