Qwen3 8B
Qwen3 8B. Compact general-purpose, runs on any laptop.
Task Fit
Not marked for typed decisions in the current library.
Not marked for code agent in the current library.
Code generation, debugging, refactoring, and benchmark signal.
General writing, Q&A, and assistant use.
Document QA benefits from long context and instruction following.
Not marked for vision in the current library.
Not marked for image generation in the current library.
Not marked for video generation in the current library.
Not marked for voice in the current library.
Evidence level
How this is assessed →Memory and hardware-fit values are planning estimates unless a tested report is linked.
Variants and Quant Artifacts
Choose the artifact first; hardware fit follows from RAM, VRAM, format, and runtime.
| Quant | Format | Quality | Min RAM | Reco RAM | Runtime | Action |
|---|---|---|---|---|---|---|
| Q4_K_M | gguf | balanced | 8GB | 16GB | ollama, llama.cpp, lm-studio | Plan with this |
| Q5_K_M | gguf | balanced | 8GB | 16GB | ollama, llama.cpp, lm-studio | Plan with this |
| Q8_0 | gguf | high | 11GB | 16GB | ollama, llama.cpp, lm-studio | Plan with this |
Recommended Hardware
Lowest estimated 5-year cost that can run this model.
Enough unified/system memory with a balanced 5-year cost.
Highest local performance signal among compatible hardware.
Benchmarks
Sources and compatibility
Execution evidence
Run Qwen3 8B with a documented recipe
Recipes connect hardware, a model artifact, tools, settings, verification, and a reportable result.
Run Qwen3 8B Q4 locally with Ollama on a 16GB Apple Silicon Mac
A conservative Ollama path for local chat and coding experiments using Qwen3 8B Q4_K_M, Metal acceleration, a modest context window, and a repeatable API check.
Run Qwen3 8B Q4 in LM Studio on a 16GB Apple Silicon Mac
A desktop-first local chat and API path using LM Studio, a Qwen3 8B Q4_K_M GGUF artifact, Metal acceleration, and an 8K baseline context.
Run Open WebUI, Ollama, and Qwen3 8B on a MacBook Pro M4 16GB
A reproducible two-layer local chat stack for a 16GB M4 Mac: Ollama loads Qwen3 8B Q4 with Metal, while Open WebUI provides persistent conversations and a browser interface. Compatibility is documented, but this exact complete stack still needs its first submitted run report.
Similar Models
Alibaba's flagship Qwen3. Competitive with GPT-4 class models.
Qwen3.8-2.4T-A95B is Alibaba Qwen's open-weight, text-only flagship MoE model with 2.4T total parameters and 95B activated parameters. It uses mandatory thinking, supports tool use, has a native 262K context window extensible to about 1.01M tokens, and ships in official BF16 and FP8 repositories. Its multi-terabyte weights target distributed data-center inference with vLLM, SGLang, or TokenSpeed rather than consumer local hardware.
Qwen3.8-27B is Alibaba Qwen's Apache 2.0 open-weight dense vision-language model for coding, professional work, research, and long-horizon agents. It has 27B parameters, a native 262K context window extensible to 1M tokens, flexible reasoning effort, tool use, official BF16 and FP8 weights, and a broad community quantization ecosystem for consumer GPUs and Apple Silicon.