openbmb/minicpm/minicpm5-deploy

Claude Code and agent skill by openbmb/minicpm

Trust tier 2
  • community
LLM review pending
Source check pending

Checking that the SKILL.md file is still in the repository.

Pick the right inference backend for a MiniCPM5-1B or MiniCPM5-2B checkpoint and route to a backend-specific cookbook skill. Use when the user wants to deploy / serve / chat-with / benchmark a MiniCPM5 model and has not yet committed to a specific engine, or when they say "deploy MiniCPM5", "run MiniCPM5", "serve MiniCPM5", "MiniCPM5 推理", "部署 MiniCPM5".

Install

npx vskill@latest install openbmb/minicpm/minicpm5-deploy

SKILL.md

The same SKILL.md was published earlier as openbmb/minicpm/minicpm5-deploy.

Deploy MiniCPM5-1B and MiniCPM5-2B — backend router

You're being asked to deploy / serve / chat-with a MiniCPM5-1B or MiniCPM5-2B checkpoint. Your job is to pick exactly one backend skill below based on the user's hardware, format, and goal, then invoke that skill rather than improvising.

1. Required input from the user

Before picking a backend, you MUST know:

VariableExampleWhere to ask
MODEL_PATHHF id openbmb/MiniCPM5-2B or openbmb/MiniCPM5-1B or a local path"Which checkpoint? HF id or local path?"
HardwareNVIDIA GPU / Apple Silicon / CPU onlyinfer from context, otherwise ask
Goal"interactive chat" / "OpenAI server" / "Python script" / "benchmark"infer from context
Available checkpoints on Hugging Face
VariantHF repoUse with
HF fp16 (recommended)`openbmb/MiniCPM5-2B` or `openbmb/MiniCPM5-1B`transformers / vllm (no --quantization) / vllm-ascend / sglang / any minicpm5-finetune-*
GGUF F16 / Q8_0 / Q4_K_M`openbmb/MiniCPM5-2B-GGUF` or `openbmb/MiniCPM5-1B-GGUF`minicpm5-deploy-llama-cpp / -ollama / -lmstudio
MLX (Apple Silicon)`openbmb/MiniCPM5-2B-MLX` or `openbmb/MiniCPM5-1B-MLX`minicpm5-deploy-mlx
LiteRT-LM .litertlm (Android / iOS / desktop / IoT, CPU + GPU)`litert-community/MiniCPM5-2B` or `litert-community/MiniCPM5-1B`minicpm5-deploy-litert

If the user has a local copy, accept any directory path that contains config.json and model.safetensors (or the equivalent GGUF / MLX layout).

2. Decision matrix — pick exactly one

User says / wantsHardwareFormat→ Skill to invoke
"Quick Python script" / "one-shot generation" / "no server"any GPU or CPUHF safetensors`minicpm5-deploy-transformers`
"OpenAI server" / "production serving" / "high QPS"NVIDIA GPUHF safetensors`minicpm5-deploy-vllm`
"vLLM-Ascend" / "Ascend NPU" / "CANN" / "torch_npu"Huawei Ascend NPUHF safetensors`minicpm5-deploy-vllm-ascend`
"RadixAttention" / "prefix cache" / "batched eval"NVIDIA GPUHF safetensors`minicpm5-deploy-sglang`
"GGUF" / "llama.cpp" / "llama-cli" / "CPU only"any CPU + optional GPUGGUF`minicpm5-deploy-llama-cpp`
"Ollama" / "ollama run" / "Modelfile"macOS / Linux laptopGGUF`minicpm5-deploy-ollama`
"LM Studio" / "desktop GUI"macOS / Windows / LinuxGGUF or MLX`minicpm5-deploy-lmstudio`
"MLX" / "Apple Silicon native" / "fastest on Mac"Apple SiliconMLX`minicpm5-deploy-mlx`
"Android" / "on-device app" / "Edge Gallery" / "LiteRT" / "LiteRT-LM" / "litertlm" / "Raspberry Pi"Android phone, iPhone, desktop or IoT board (CPU or GPU)LiteRT-LM .litertlm`minicpm5-deploy-litert`

If the user has not specified any of the above and asks "how do I run this?":

  • CUDA box, want fastest server: pick minicpm5-deploy-vllm.
  • Ascend NPU, want an OpenAI-compatible server: pick minicpm5-deploy-vllm-ascend.
  • CUDA box, want minimal Python: pick minicpm5-deploy-transformers.
  • Apple Silicon laptop: pick minicpm5-deploy-ollama (easiest) or minicpm5-deploy-mlx (fastest).
  • Android phone, or an on-device app (Android / iOS): pick minicpm5-deploy-litert.
  • CPU only / Windows / low-VRAM: pick minicpm5-deploy-llama-cpp (Q4_K_M).

3. Invocation contract

Once you've picked a backend skill, invoke that skill with `MODEL_PATH` set. Do NOT inline the backend's commands here — each backend has its own pitfalls (mandatory flags, env-var pins, install order) that the dedicated skill handles. The user explicitly does NOT want you to "improvise" — read the picked sub-skill in full first.

4. Sanity check after deploy

Whichever backend you pick, after launch run this universal sanity check:

bash
# Replace localhost:PORT with the backend's actual port (default in each sub-skill)
curl http://localhost:PORT/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "MiniCPM5-2B",
"messages": [{"role":"user","content":"1+1=?"}],
"temperature": 1.0, "top_p": 0.95, "max_tokens": 64,
"chat_template_kwargs": {"enable_thinking": true}
}'

Expected: HTTP 200 with choices[0].message.content containing "2".

minicpm5-deploy-litert also serves this endpoint: after litert-lm import … minicpm5-2b, litert-lm serve listens on port 9379 (guide); use "model": "minicpm5-2b", add "reasoning_effort": "none" for a direct answer, and cap with max_completion_tokens.

5. Known cross-backend pitfalls

These are common to multiple backends — surface to the user up front:

  • Think vs no-think: MiniCPM5-2B uses Think mode with temperature=1.0, top_p=0.95. MiniCPM5-1B also supports No-think with enable_thinking=false + temperature=0.7, top_p=0.95.
  • 128 K context: max_position_embeddings=131072, rope_theta=5e6, no rope-scaling. Pass --max-model-len 131072 (vLLM) / --context-length 131072 (SGLang) / -c 131072 (llama.cpp) to use the full window. Lower if VRAM is tight.
  • Untied lm_head: tie_word_embeddings=false. Tools that assume the Llama tied default (e.g. mlx_lm.convert < 0.31) will silently drop lm_head → output collapses to random tokens. The MLX skill bakes in the fix.

6. Don't reinvent: link to the cookbook

Each sub-skill is paired with a one-page cookbook in `docs/deployment/`. The skill is the machine-readable shortcut; the cookbook is the human-readable reference. Both are kept in sync.

Security

  • Security scanPassed, 100 of 100Pattern checks on the skill's files.
  • Model reviewNot runA model review is scheduled for the next rescan.

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

Source

Popularity

Repository stars
9,518
Repository forks
625
7-day trend score
46

Stars and forks are for the whole GitHub repository, not this skill alone. Not refreshed yet.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/openbmb/minicpm/minicpm5-deploy/badge)](https://verified-skill.com/skills/openbmb/minicpm/minicpm5-deploy)

Something wrong with this skill or its page? Tell us.