openbmb/minicpm/minicpm5-deploy-mlx
Claude Code and agent skill by openbmb/minicpm
- community
Checking that the SKILL.md file is still in the repository.
Run MiniCPM5-1B or MiniCPM5-2B natively on Apple Silicon with Apple's MLX framework. Use when the user has an Apple Silicon Mac and asks for "MLX", "mlx_lm", "mlx_lm.convert", "mlx_lm.generate", or wants the fastest path on Apple Silicon.
Install
npx vskill@latest install openbmb/minicpm/minicpm5-deploy-mlxSKILL.md
The same SKILL.md was published earlier as openbmb/minicpm/minicpm5-deploy-mlx.
Deploy MiniCPM5-1B and MiniCPM5-2B with MLX (Apple Silicon)
Apple's on-device tensor framework. Highest throughput on M-series. Stays inside one Python process — no separate server, no llama.cpp build chain.
Required input
| Var | Example | Default | |
|---|---|---|---|
MLX_REPO | openbmb/MiniCPM5-2B-MLX (pre-converted 4-bit affine) | required; openbmb/MiniCPM5-1B-MLX also works | |
OR HF_REPO + QUANT | openbmb/MiniCPM5-2B, 4bit or bf16 | for local conversion | |
MAX_TOKENS | 200 | 200 |
Steps
1. Install (once)
2A. Use a pre-converted MLX repo (recommended when available)
2B. Convert from a HF checkpoint locally (advanced)
Use mlx_lm.convert only if you have a self-trained HF fp16 checkpoint:
Then run as in 2A.
3. Validate
The reply should contain "2" for 1+1=?.
OpenAI-compatible server (mlx-lm)
Common pitfalls
- Slow first generate: MLX JIT-compiles kernels on first call (~5-10 s); subsequent calls hit the warm cache.
- Model runs past `<|im_end|>`: only happens on
mlx-lm < 0.31(older versions ignore multi-ideos_token_idlists). Upgrade, or pass--extra-eos-token "<|im_end|>"as a manual override —<|im_end|>is token id 130073 and is already listed ingeneration_config.jsonon 0.31+.
When NOT to use
- Not on Apple Silicon →
minicpm5-deploy-llama-cpp(CPU/CUDA) orminicpm5-deploy-vllm(CUDA) - Want a desktop GUI →
minicpm5-deploy-lmstudio(LM Studio bundles an MLX runtime) - Want one-line CLI run →
minicpm5-deploy-ollama
Reference
Security
- Security scanPassed, 100 of 100Pattern checks on the skill's files.
- Model reviewNot runA model review is scheduled for the next rescan.
Quality evaluation
- Task evaluationNot runNo evaluation yet. Run one in Skill Studio.
Source
- SKILL.md in the repositoryCheckingskills/minicpm5-deploy-mlx/SKILL.md
Popularity
- Repository stars
- 9,518
- Repository forks
- 625
- 7-day trend score
- 46
Stars and forks are for the whole GitHub repository, not this skill alone. Not refreshed yet.
Works with
Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.
- Claude Code
- Cursor
- GitHub Copilot
- Windsurf
- Codex
- Gemini CLI
- Cline
- Amp
- Roo Code
- Goose
- Continue
- Kilo Code
- Junie
- Trae
- OpenHands
- Qwen Code
- AI Agent
- Tabnine Chat
- Sourcegraph Cody
- Amazon Q
- Firebase Genkit
- Sweep
- Devin
- Phind
- Mentat
- Claude Desktop
- Aider
- GPT Pilot
- Plandex
- bolt.new
- v0
- Replit Agent
- Anse
- TypingMind
- BetterChatGPT
- LibreChat
- Warp AI
- Pieces
- Fig AI
Embed badge
[](https://verified-skill.com/skills/openbmb/minicpm/minicpm5-deploy-mlx)