openbmb/minicpm/minicpm5-deploy-vllm
Claude Code and agent skill by openbmb/minicpm
- community
Checking that the SKILL.md file is still in the repository.
Serve MiniCPM5-1B or MiniCPM5-2B via vLLM as an OpenAI-compatible HTTP server. Use when the user wants high-throughput production serving on NVIDIA GPU, asks for "vLLM", "OpenAI server", "REST API for MiniCPM5", or "production deployment".
Install
npx vskill@latest install openbmb/minicpm/minicpm5-deploy-vllmSKILL.md
The same SKILL.md was published earlier as openbmb/minicpm/minicpm5-deploy-vllm.
Deploy MiniCPM5-1B and MiniCPM5-2B with vLLM
OpenAI-compatible server for the BF16 / FP16 MiniCPM5-1B or MiniCPM5-2B checkpoint.
Required input
| Var | Example | Default | |
|---|---|---|---|
MODEL_PATH | openbmb/MiniCPM5-2B | required; openbmb/MiniCPM5-1B also works | |
PORT | 8000 | 8000 | |
GPU_ID | 0 | 0 | |
CTX_LEN | 131072 (128 K) | 131072; lower if VRAM tight | |
MEM_FRAC | 0.85 | 0.85; lower on shared GPUs |
Steps
1. Install (once)
2. Launch
Wait for Application startup complete in the log.
3. Validate
Expected: choices[0].message.content contains a coherent answer.
Sampling defaults
Common pitfalls
- `(free / total) < MEM_FRAC` hard error: lower
--gpu-memory-utilization(e.g. 0.5 on a shared GPU). - OOM at startup with 128 K: drop
--max-model-lento 32768 or 8192.
Tool calling (plugin)
The vLLM-side MiniCPM5 XML parser (PR #43175) merged to main on 2026-05-27 but is not in any pip release yet (v0.22.0 was cut before the merge). Use the bridge plugin shipped at tool_parsers/minicpm5xml_tool_parser.py in this repo:
Drop --tool-parser-plugin once vLLM ships a release containing the parser natively.
When NOT to use
- One-shot Python script →
minicpm5-deploy-transformers - Apple Silicon / no NVIDIA GPU →
minicpm5-deploy-llama-cpp/minicpm5-deploy-mlx - High-concurrency batch eval w/ prefix cache or tool calling →
minicpm5-deploy-sglang
Reference
Security
- Security scanPassed, 100 of 100Pattern checks on the skill's files.
- Model reviewNot runA model review is scheduled for the next rescan.
Quality evaluation
- Task evaluationNot runNo evaluation yet. Run one in Skill Studio.
Source
- SKILL.md in the repositoryCheckingskills/minicpm5-deploy-vllm/SKILL.md
Popularity
- Repository stars
- 9,518
- Repository forks
- 625
- 7-day trend score
- 46
Stars and forks are for the whole GitHub repository, not this skill alone. Not refreshed yet.
Works with
Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.
- Claude Code
- Cursor
- GitHub Copilot
- Windsurf
- Codex
- Gemini CLI
- Cline
- Amp
- Roo Code
- Goose
- Continue
- Kilo Code
- Junie
- Trae
- OpenHands
- Qwen Code
- AI Agent
- Tabnine Chat
- Sourcegraph Cody
- Amazon Q
- Firebase Genkit
- Sweep
- Devin
- Phind
- Mentat
- Claude Desktop
- Aider
- GPT Pilot
- Plandex
- bolt.new
- v0
- Replit Agent
- Anse
- TypingMind
- BetterChatGPT
- LibreChat
- Warp AI
- Pieces
- Fig AI
Embed badge
[](https://verified-skill.com/skills/openbmb/minicpm/minicpm5-deploy-vllm)