openlair/dr-claw/llava
Claude Code and agent skill by openlair/dr-claw
- community
Checking that the SKILL.md file is still in the repository.
Large Language and Vision Assistant. Enables visual instruction tuning and image-based conversations. Combines CLIP vision encoder with Vicuna/LLaMA language models. Supports multi-turn image chat, visual question answering, and instruction following. Use for vision-language chatbots or image understanding tasks. Best for conversational image analysis. Also covers BLIP-2 (guides in references/).
Install
npx vskill@latest install openlair/dr-claw/llavaSKILL.md
The same SKILL.md was published earlier as openlair/dr-claw/llava.
LLaVA - Large Language and Vision Assistant
Open-source vision-language model for conversational image understanding.
When to use LLaVA
Use when:
- Building vision-language chatbots
- Visual question answering (VQA)
- Image description and captioning
- Multi-turn image conversations
- Visual instruction following
- Document understanding with images
Metrics:
- 23,000+ GitHub stars
- GPT-4V level capabilities (targeted)
- Apache 2.0 License
- Multiple model sizes (7B-34B params)
Use alternatives instead:
- GPT-4V: Highest quality, API-based
- CLIP: Simple zero-shot classification
- BLIP-2: Better for captioning only
- Flamingo: Research, not open-source
Quick start
Installation
Basic usage
Available models
| Model | Parameters | VRAM | Quality | |
|---|---|---|---|---|
| LLaVA-v1.5-7B | 7B | ~14 GB | Good | |
| LLaVA-v1.5-13B | 13B | ~28 GB | Better | |
| LLaVA-v1.6-34B | 34B | ~70 GB | Best |
CLI usage
Web UI (Gradio)
Multi-turn conversations
Common tasks
Image captioning
Visual question answering
Object detection (textual)
Scene understanding
Document understanding
Training custom model
Quantization (reduce VRAM)
Best practices
- Start with 7B model - Good quality, manageable VRAM
- Use 4-bit quantization - Reduces VRAM significantly
- GPU required - CPU inference extremely slow
- Clear prompts - Specific questions get better answers
- Multi-turn conversations - Maintain conversation context
- Temperature 0.2-0.7 - Balance creativity/consistency
- max_new_tokens 512-1024 - For detailed responses
- Batch processing - Process multiple images sequentially
Performance
| Model | VRAM (FP16) | VRAM (4-bit) | Speed (tokens/s) | |
|---|---|---|---|---|
| 7B | ~14 GB | ~4 GB | ~20 | |
| 13B | ~28 GB | ~8 GB | ~12 | |
| 34B | ~70 GB | ~18 GB | ~5 |
On A100 GPU
Benchmarks
LLaVA achieves competitive scores on:
- VQAv2: 78.5%
- GQA: 62.0%
- MM-Vet: 35.4%
- MMBench: 64.3%
Limitations
- Hallucinations - May describe things not in image
- Spatial reasoning - Struggles with precise locations
- Small text - Difficulty reading fine print
- Object counting - Imprecise for many objects
- VRAM requirements - Need powerful GPU
- Inference speed - Slower than CLIP
Integration with frameworks
LangChain
Gradio App
Resources
- GitHub: https://github.com/haotian-liu/LLaVA ⭐ 23,000+
- Paper: https://arxiv.org/abs/2304.08485
- Demo: https://llava.hliu.cc
- Models: https://huggingface.co/liuhaotian
- License: Apache 2.0
Related tools (merged into this skill)
These were separate skills. Their full guides now live under references/; read the one you need when the user asks for that tool or it fits the task better.
| Tool | Guide | What it covers | |
|---|---|---|---|
| BLIP-2 | references/blip-2/overview.md | Vision-language pre-training framework bridging frozen image encoders and LLMs. |
Security
- Security scanPassed, 96 of 100Pattern checks on the skill's files.
- Model reviewNot runA model review is scheduled for the next rescan.
Quality evaluation
- Task evaluationNot runNo evaluation yet. Run one in Skill Studio.
Source
- SKILL.md in the repositoryCheckingskills/multimodal/llava/SKILL.md
Popularity
- Repository stars
- 953
- Repository forks
- 97
- Repository npm downloads, 7 days
- 28
- 7-day trend score
- 45
Stars and forks are for the whole GitHub repository, not this skill alone. Downloads are for the repository's npm package. Refreshed 18 May 2026, 6 months ago.
Works with
Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.
- Claude Code
- Cursor
- GitHub Copilot
- Windsurf
- Codex
- Gemini CLI
- Cline
- Amp
- Roo Code
- Goose
- Continue
- Kilo Code
- Junie
- Trae
- OpenHands
- Qwen Code
- AI Agent
- Tabnine Chat
- Sourcegraph Cody
- Amazon Q
- Firebase Genkit
- Sweep
- Devin
- Phind
- Mentat
- Claude Desktop
- Aider
- GPT Pilot
- Plandex
- bolt.new
- v0
- Replit Agent
- Anse
- TypingMind
- BetterChatGPT
- LibreChat
- Warp AI
- Pieces
- Fig AI
Embed badge
[](https://verified-skill.com/skills/openlair/dr-claw/llava)