M4 Ultra (192 GB) — benchmark record
M4 Ultra (192 GB) local LLM benchmarks on Apple Silicon Mac with 8 published rows across 8 models. Peak published speed is 45.0 tok/s on Mistral Small 4 119B. Published runtimes include MLX, Ollama.
Quick take
Best published speed here is 45.0 tok/s on Mistral Small 4 119B at Q4_K - Medium. This page is evidence, not the full buying answer.
Based on 8 external benchmarks; no lab runs yet.
Published runtimes: MLX, Ollama.
Current published coverage
Published model coverage includes Mistral Small 4 119B, Qwen 3 32B, Llama 4 Scout 17B-16E, Qwen 3 235B-A22B plus 4 more published models. Published runtime coverage on this chip includes MLX, Ollama. Fastest published row is 45.0 tok/s on Mistral Small 4 119B at Q4_K - Medium.
Raw benchmark rows for M4 Ultra (192 GB)
Rows sorted by avg tok/s descending. Click source badge to see original measurement page.
| Model | Quant | Avg tok/s | Runtime | Source |
|---|---|---|---|---|
| Mistral Small 4 119B | Q4_K - Medium | 45.0 tok/s | MLX | ref |
| Qwen 3 32B | Q4_K - Medium | 32.0 tok/s | Ollama | ref |
| Llama 4 Scout 17B-16E | Q4_K - Medium | 30.0 tok/s | MLX | ref |
| Qwen 3 235B-A22B | Q4_K - Medium | 22.0 tok/s | MLX | ref |
| Llama 3.3 70B | Q4_K - Medium | 18.0 tok/s | MLX | ref |
| DeepSeek R1 Distill Llama 70B | Q4_K - Medium | 16.0 tok/s | MLX | ref |
| Qwen 2.5 72B | Q4_K - Medium | 15.0 tok/s | Ollama | ref |
| gpt-oss 120B | Q4_K - Medium | 10.0 tok/s | MLX | ref |
Models tested on this chip
Next step
Use Rankings when you need the best overall answer for a Mac, and keep this page open when you need the evidence behind that recommendation.
If you are comparing local Apple Silicon against rented cloud hardware, use AI Data Center Index for current GPU rental context.
Data
benchmarks.json — full dataset · chips.json — chip summaries · benchmarks.csv — CSV export
Data from in-house lab measurements plus community-published benchmarks. See all chip families →