vectorspacelab/arex-skill/actor-critic-policy-iteration

Claude Code and agent skill by vectorspacelab/arex-skill

Trust tier 3
  • community
Source check pending

Checking that the SKILL.md file is still in the repository.

Apply policy-iteration style actor updates and verify objective improvement under compatible gradients.

Install

npx vskill@latest install vectorspacelab/arex-skill/actor-critic-policy-iteration

SKILL.md

The same SKILL.md was published earlier as vectorspacelab/arex-skill/actor-critic-policy-iteration.

Actor Critic Policy Iteration

Use this skill when reproducing or checking policy-gradient actor-critic mechanisms from Sutton, McAllester, Singh, and Mansour (1999) without relying on an original implementation repository.

Inputs

  • A finite discounted MDP or a tiny generated proxy task.
  • Differentiable stochastic-policy parameters, preferably softmax-linear features.
  • Numeric tolerances for gradient, orthogonality, and improvement checks.

Outputs

  • Deterministic JSON-compatible quantities suitable for recovery evidence.
  • Explicit failures when assumptions such as differentiability or compatible features are not met.

Workflow

  1. Read the module contract and identify the paper mechanism being tested.
  2. Use exact finite-MDP computations for deterministic checks whenever possible.
  3. Keep source boundaries strict: use the paper, generated modules, and generated skills, not an original source repository.
  4. Save command outputs and numeric metrics as auditable artifacts.
  5. Treat reduced/proxy recovery as valid only when it exercises the theorem mechanism.

Validation

Run python ../../../../Paper2Skills/Paper2Skills-Agent/src/packages/paper2skills-agent/src/paper2skills/skills/module-to-skill/scripts/validate_skill_tree.py <skill_dir> --run-tests or invoke the local tests with the Distiller validator.

Limitations

This skill validates the theorem mechanism on finite MDPs. It is not a benchmark implementation for large-scale reinforcement-learning tasks.

Security

  • Security scanPassed, 90 of 100Pattern checks on the skill's files.
  • Model reviewPassed

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

Source

Popularity

7-day trend score
0

Not refreshed yet.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/vectorspacelab/arex-skill/actor-critic-policy-iteration/badge)](https://verified-skill.com/skills/vectorspacelab/arex-skill/actor-critic-policy-iteration)

Something wrong with this skill or its page? Tell us.