| 1 | Mac Studio M3 Ultra 256GB | 323 | 8bit | 26.0 tok/s Fastest evidence path: 8bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 152.5 GB | 631k | Estimated | $7,499 | 8bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 152.5 GB headroom remains at this quantization. |
| 2 | Mac Pro M2 Ultra 192GB | 259 | 8bit | 26.0 tok/s Fastest evidence path: 8bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 88.5 GB | 334k | Estimated | $6,999 | 8bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 88.5 GB headroom remains at this quantization. |
| 3 | Mac Studio M4 Max 128GB | 195 | 8bit | 26.0 tok/s Fastest evidence path: 8bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 24.5 GB | 37k | Estimated | $4,499 | 8bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 24.5 GB headroom remains at this quantization. |
| 4 | MacBook Pro M5 Max 128GB 16-inch | 195 | 8bit | 26.0 tok/s Fastest evidence path: 8bit · 26.0 tok/s · Ollama · Estimated | Ollama | Fits | 24.5 GB | 37k | Estimated | $5,399 | 8bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 24.5 GB headroom remains at this quantization. |
| 5 | MacBook Pro M4 Max 128GB 16-inch | 195 | 8bit | 26.0 tok/s Fastest evidence path: 8bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 24.5 GB | 37k | Estimated | $5,999 | 8bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 24.5 GB headroom remains at this quantization. |
| 6 | Mac Studio M3 Ultra 96GB | 182 | 6bit | 26.0 tok/s Fastest evidence path: 6bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 17.9 GB | 27k | Estimated | $3,999 | 6bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 17.9 GB headroom remains at this quantization. |
| 7 | Mac Studio M4 Max 64GB | 168 | q4.1bit | 26.0 tok/s Fastest evidence path: q4.1bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 10.0 GB | 10k | Estimated | $2,999 | q4.1bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 10.0 GB headroom remains at this quantization. |
| 8 | MacBook Pro M4 Max 64GB 16-inch | 168 | q4.1bit | 26.0 tok/s Fastest evidence path: q4.1bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 10.0 GB | 10k | Estimated | $4,499 | q4.1bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 10.0 GB headroom remains at this quantization. |
| 9 | Mac Mini M4 Pro 48GB | 136 | 3bit | 26.0 tok/s Fastest evidence path: 3bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 7.9 GB | 12k | Estimated | $1,599 | 3bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 7.9 GB headroom remains at this quantization. |
| 10 | MacBook Pro M4 Pro 48GB 14-inch | 136 | 3bit | 26.0 tok/s Fastest evidence path: 3bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 7.9 GB | 12k | Estimated | $2,499 | 3bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 7.9 GB headroom remains at this quantization. |
| 11 | Mac Studio M4 Max 48GB | 136 | 3bit | 26.0 tok/s Fastest evidence path: 3bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 7.9 GB | 12k | Estimated | $2,499 | 3bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 7.9 GB headroom remains at this quantization. |
| 12 | MacBook Pro M4 Pro 48GB 16-inch | 136 | 3bit | 26.0 tok/s Fastest evidence path: 3bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 7.9 GB | 12k | Estimated | $2,999 | 3bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 7.9 GB headroom remains at this quantization. |
| 13 | MacBook Pro M4 Max 48GB 14-inch | 136 | 3bit | 26.0 tok/s Fastest evidence path: 3bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 7.9 GB | 12k | Estimated | $3,499 | 3bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 7.9 GB headroom remains at this quantization. |
| 14 | MacBook Pro M4 Max 48GB 16-inch | 136 | 3bit | 26.0 tok/s Fastest evidence path: 3bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 7.9 GB | 12k | Estimated | $3,999 | 3bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 7.9 GB headroom remains at this quantization. |
| 15 | Mac Studio M4 Max 36GB | 135 | IQ2_K_S | 26.0 tok/s Fastest evidence path: IQ2_K_S · 26.0 tok/s · MLX · Estimated | MLX | Fits | 7.4 GB | 19k | Estimated | $1,999 | IQ2_K_S is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 7.4 GB headroom remains at this quantization. |
| 16 | MacBook Pro M4 Max 36GB 14-inch | 135 | IQ2_K_S | 26.0 tok/s Fastest evidence path: IQ2_K_S · 26.0 tok/s · MLX · Estimated | MLX | Fits | 7.4 GB | 19k | Estimated | $2,999 | IQ2_K_S is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 7.4 GB headroom remains at this quantization. |
| 17 | MacBook Pro M4 Max 36GB 16-inch | 135 | IQ2_K_S | 26.0 tok/s Fastest evidence path: IQ2_K_S · 26.0 tok/s · MLX · Estimated | MLX | Fits | 7.4 GB | 19k | Estimated | $3,499 | IQ2_K_S is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 7.4 GB headroom remains at this quantization. |
| 18 | Mac Mini M4 16GB | 0 | F32 | — | MLX | No | -392.1 GB | — | Estimated | $499 | Llama 4 Scout 17B-16E does not fit on Mac Mini M4 16GB at the current practical quantization. |
| 19 | Mac Mini M4 24GB | 0 | F32 | — | MLX | No | -384.1 GB | — | Estimated | $599 | Llama 4 Scout 17B-16E does not fit on Mac Mini M4 24GB at the current practical quantization. |
| 20 | Mac Mini M4 32GB | 0 | F32 | — | MLX | No | -376.1 GB | — | Estimated | $799 | Llama 4 Scout 17B-16E does not fit on Mac Mini M4 32GB at the current practical quantization. |
| 21 | MacBook Air M4 16GB 13-inch | 0 | F32 | — | MLX | No | -392.1 GB | — | Estimated | $1,099 | Llama 4 Scout 17B-16E does not fit on MacBook Air M4 16GB 13-inch at the current practical quantization. |
| 22 | MacBook Air M4 24GB 13-inch | 0 | F32 | — | MLX | No | -384.1 GB | — | Estimated | $1,299 | Llama 4 Scout 17B-16E does not fit on MacBook Air M4 24GB 13-inch at the current practical quantization. |
| 23 | MacBook Air M4 16GB 15-inch | 0 | F32 | — | MLX | No | -392.1 GB | — | Estimated | $1,299 | Llama 4 Scout 17B-16E does not fit on MacBook Air M4 16GB 15-inch at the current practical quantization. |
| 24 | Mac Mini M4 Pro 24GB | 0 | F32 | — | MLX | No | -384.1 GB | — | Estimated | $1,399 | Llama 4 Scout 17B-16E does not fit on Mac Mini M4 Pro 24GB at the current practical quantization. |
| 25 | MacBook Air M4 32GB 13-inch | 0 | F32 | — | MLX | No | -376.1 GB | — | Estimated | $1,499 | Llama 4 Scout 17B-16E does not fit on MacBook Air M4 32GB 13-inch at the current practical quantization. |
| 26 | MacBook Air M4 24GB 15-inch | 0 | F32 | — | MLX | No | -384.1 GB | — | Estimated | $1,499 | Llama 4 Scout 17B-16E does not fit on MacBook Air M4 24GB 15-inch at the current practical quantization. |
| 27 | MacBook Air M4 32GB 15-inch | 0 | F32 | — | MLX | No | -376.1 GB | — | Estimated | $1,699 | Llama 4 Scout 17B-16E does not fit on MacBook Air M4 32GB 15-inch at the current practical quantization. |
| 28 | MacBook Pro M4 Pro 24GB 14-inch | 0 | F32 | — | MLX | No | -384.1 GB | — | Estimated | $1,999 | Llama 4 Scout 17B-16E does not fit on MacBook Pro M4 Pro 24GB 14-inch at the current practical quantization. |
| 29 | MacBook Pro M4 Pro 24GB 16-inch | 0 | F32 | — | MLX | No | -384.1 GB | — | Estimated | $2,499 | Llama 4 Scout 17B-16E does not fit on MacBook Pro M4 Pro 24GB 16-inch at the current practical quantization. |