yzj623/pplab/actor-critic-policy-iteration
Claude Code and agent skill by yzj623/pplab
- community
Checking that the SKILL.md file is still in the repository.
Apply policy-iteration style actor updates and verify objective improvement under compatible gradients.
Install
npx vskill@latest install yzj623/pplab/actor-critic-policy-iterationSKILL.md
The same SKILL.md was published earlier as vectorspacelab/arex-skill/actor-critic-policy-iteration.
Actor Critic Policy Iteration
Use this skill when reproducing or checking policy-gradient actor-critic mechanisms from Sutton, McAllester, Singh, and Mansour (1999) without relying on an original implementation repository.
Inputs
- A finite discounted MDP or a tiny generated proxy task.
- Differentiable stochastic-policy parameters, preferably softmax-linear features.
- Numeric tolerances for gradient, orthogonality, and improvement checks.
Outputs
- Deterministic JSON-compatible quantities suitable for recovery evidence.
- Explicit failures when assumptions such as differentiability or compatible features are not met.
Workflow
- Read the module contract and identify the paper mechanism being tested.
- Use exact finite-MDP computations for deterministic checks whenever possible.
- Keep source boundaries strict: use the paper, generated modules, and generated skills, not an original source repository.
- Save command outputs and numeric metrics as auditable artifacts.
- Treat reduced/proxy recovery as valid only when it exercises the theorem mechanism.
Validation
Run python ../../../../Paper2Skills/Paper2Skills-Agent/src/packages/paper2skills-agent/src/paper2skills/skills/module-to-skill/scripts/validate_skill_tree.py <skill_dir> --run-tests or invoke the local tests with the Distiller validator.
Limitations
This skill validates the theorem mechanism on finite MDPs. It is not a benchmark implementation for large-scale reinforcement-learning tasks.
Security
- Security scanPassed, 90 of 100Pattern checks on the skill's files.
- Model reviewPassed
Quality evaluation
- Task evaluationNot runNo evaluation yet. Run one in Skill Studio.
Source
- SKILL.md in the repositoryCheckingResearchAgent-Skill/skill_library/paperbench/sapg/skill/actor_critic_algorithms/actor_critic_policy_iteration/SKILL.md
Popularity
- 7-day trend score
- 5
Not refreshed yet.
Works with
Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.
- Claude Code
- Cursor
- GitHub Copilot
- Windsurf
- Codex
- Gemini CLI
- Cline
- Amp
- Roo Code
- Goose
- Continue
- Kilo Code
- Junie
- Trae
- OpenHands
- Qwen Code
- AI Agent
- Tabnine Chat
- Sourcegraph Cody
- Amazon Q
- Firebase Genkit
- Sweep
- Devin
- Phind
- Mentat
- Claude Desktop
- Aider
- GPT Pilot
- Plandex
- bolt.new
- v0
- Replit Agent
- Anse
- TypingMind
- BetterChatGPT
- LibreChat
- Warp AI
- Pieces
- Fig AI
Embed badge
[](https://verified-skill.com/skills/yzj623/pplab/actor-critic-policy-iteration)