A step up from the 3B version for a computer with more memory. Use it for grounded writing and image questions.
Where it works well
- Text and image inputs in one model.
- Multilingual conversations.
- Instruction following and structured output.
Common use cases
- Summarize a short document excerpt.
- Discuss a screenshot.
- Draft alternative wording in another language.
Know its limits
- Images and longer chats add memory beyond the download size.
- Image interpretation and translations need checking.
Run it on your computer
Start with a compressed download and a short conversation. Our estimate is about 16 GB of total RAM or Mac unified memory, with room for the operating system. The listed 6.0 GB download is the model file, not its full running memory use.
Check the model’s supported runtime and hardware before loading it. System RAM on a PC and unified memory on a Mac are different from dedicated NVIDIA VRAM. A memory match doesn’t guarantee compatibility or speed. Choose a smaller model if responses are too slow.
Use a desktop app that supports the listed model format, such as LM Studio or Ollama. Download the exact local variant, load it in Chat, and start with one small task. Model downloads need internet; local chat can work offline once the model is downloaded.
Official model information
Model capabilities checked October 2026. The use cases above are practical starting suggestions, not performance guarantees.