openbmb/minicpm/minicpm5-deploy-transformers
Claude Code and agent skill by openbmb/minicpm
- community
Checking that the SKILL.md file is still in the repository.
Run MiniCPM5-1B or MiniCPM5-2B with Hugging Face Transformers for one-shot Python generation on GPU (bfloat16) or CPU (float32). Use when the user wants a quick Python script, no server, no extra deps, or asks for "Transformers", "AutoModelForCausalLM", "model.generate" with MiniCPM5.
Install
npx vskill@latest install openbmb/minicpm/minicpm5-deploy-transformersSKILL.md
The same SKILL.md was published earlier as openbmb/minicpm/minicpm5-deploy-transformers.
Deploy MiniCPM5-1B and MiniCPM5-2B with HF Transformers
One-shot Python generation. No server. Works on a single GPU (bfloat16) or CPU only (fp32).
Required input
| Var | Example | Default | |
|---|---|---|---|
MODEL_PATH | openbmb/MiniCPM5-2B or local dir | required; openbmb/MiniCPM5-1B also works | |
MODE | think or nothink (nothink is 1B-only) | think |
Steps
1. Install (once)
2. Run
For CPU only: change torch_dtype=torch.float32, device_map="cpu". Keep enable_thinking=True and temperature=1.0 for MiniCPM5-2B; use enable_thinking=False and temperature=0.7 only for MiniCPM5-1B No-think mode.
Sampling defaults
| Mode | enable_thinking | temperature | top_p | |
|---|---|---|---|---|
| MiniCPM5-2B Think | True | 1.0 | 0.95 | |
| MiniCPM5-1B Think | True | 0.9 | 0.95 | |
| MiniCPM5-1B No-think | False | 0.7 | 0.95 |
Validate
A coherent answer to 1+1=? (e.g. "2" or "答案是 2").
LoRA inference
Adapters from any of the minicpm5-finetune-* skills load directly with no surgery.
When NOT to use
- Need an OpenAI-compatible HTTP server →
minicpm5-deploy-vllmorminicpm5-deploy-sglang - Apple Silicon →
minicpm5-deploy-mlxis faster - CPU-only or low-VRAM laptop →
minicpm5-deploy-llama-cppwith Q4_K_M is faster
Reference
Security
- Security scanPassed, 95 of 100Pattern checks on the skill's files.
- Model reviewPassed
Quality evaluation
- Task evaluationNot runNo evaluation yet. Run one in Skill Studio.
Source
- SKILL.md in the repositoryCheckingskills/minicpm5-deploy-transformers/SKILL.md
Popularity
- Repository stars
- 9,518
- Repository forks
- 625
- 7-day trend score
- 46
Stars and forks are for the whole GitHub repository, not this skill alone. Not refreshed yet.
Works with
Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.
- Claude Code
- Cursor
- GitHub Copilot
- Windsurf
- Codex
- Gemini CLI
- Cline
- Amp
- Roo Code
- Goose
- Continue
- Kilo Code
- Junie
- Trae
- OpenHands
- Qwen Code
- AI Agent
- Tabnine Chat
- Sourcegraph Cody
- Amazon Q
- Firebase Genkit
- Sweep
- Devin
- Phind
- Mentat
- Claude Desktop
- Aider
- GPT Pilot
- Plandex
- bolt.new
- v0
- Replit Agent
- Anse
- TypingMind
- BetterChatGPT
- LibreChat
- Warp AI
- Pieces
- Fig AI
Embed badge
[](https://verified-skill.com/skills/openbmb/minicpm/minicpm5-deploy-transformers)