| 1 | Mac Studio M3 Ultra 256GB | 373 | 8bit | 22.0 tok/s Fastest evidence path: 8bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 219.4 GB | 206k | Estimated | $7,499 | 8bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 219.4 GB headroom remains at this quantization. |
| 2 | Mac Pro M2 Ultra 192GB | 309 | 8bit | 22.0 tok/s Fastest evidence path: 8bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 155.4 GB | 146k | Estimated | $6,999 | 8bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 155.4 GB headroom remains at this quantization. |
| 3 | MacBook Pro M5 Max 128GB 16-inch | 261 | 8bit | 26.0 tok/s Fastest evidence path: 8bit · 26.0 tok/s · MLX · Estimated | MLX | Fits | 91.4 GB | 87k | Estimated | $5,399 | 8bit is the current best practical quantization. 26.0 tok/s is estimated from nearby benchmark coverage. 91.4 GB headroom remains at this quantization. |
| 4 | Mac Studio M4 Max 128GB | 245 | 8bit | 22.0 tok/s Fastest evidence path: 8bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 91.4 GB | 87k | Estimated | $4,499 | 8bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 91.4 GB headroom remains at this quantization. |
| 5 | MacBook Pro M4 Max 128GB 16-inch | 245 | 8bit | 22.0 tok/s Fastest evidence path: 8bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 91.4 GB | 87k | Estimated | $5,999 | 8bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 91.4 GB headroom remains at this quantization. |
| 6 | Mac Studio M3 Ultra 96GB | 213 | 8bit | 22.0 tok/s Fastest evidence path: 8bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 59.4 GB | 57k | Estimated | $3,999 | 8bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 59.4 GB headroom remains at this quantization. |
| 7 | Mac Studio M4 Max 64GB | 181 | 8bit | 22.0 tok/s Fastest evidence path: 8bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 27.4 GB | 28k | Estimated | $2,999 | 8bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 27.4 GB headroom remains at this quantization. |
| 8 | MacBook Pro M4 Max 64GB 16-inch | 181 | 8bit | 22.0 tok/s Fastest evidence path: 8bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 27.4 GB | 28k | Estimated | $4,499 | 8bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 27.4 GB headroom remains at this quantization. |
| 9 | Mac Mini M4 Pro 48GB | 165 | 8bit | 22.0 tok/s Fastest evidence path: 8bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 11.4 GB | 13k | Estimated | $1,599 | 8bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 11.4 GB headroom remains at this quantization. |
| 10 | MacBook Pro M4 Pro 48GB 14-inch | 165 | 8bit | 22.0 tok/s Fastest evidence path: 8bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 11.4 GB | 13k | Estimated | $2,499 | 8bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 11.4 GB headroom remains at this quantization. |
| 11 | MacBook Pro M4 Pro 48GB 16-inch | 165 | 8bit | 22.0 tok/s Fastest evidence path: 8bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 11.4 GB | 13k | Estimated | $2,999 | 8bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 11.4 GB headroom remains at this quantization. |
| 12 | Mac Studio M4 Max 36GB | 155 | 6bit | 22.0 tok/s Fastest evidence path: 6bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 6.6 GB | 9k | Estimated | $1,999 | 6bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 6.6 GB headroom remains at this quantization. |
| 13 | MacBook Pro M4 Max 36GB 14-inch | 155 | 6bit | 22.0 tok/s Fastest evidence path: 6bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 6.6 GB | 9k | Estimated | $2,999 | 6bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 6.6 GB headroom remains at this quantization. |
| 14 | MacBook Pro M4 Max 36GB 16-inch | 155 | 6bit | 22.0 tok/s Fastest evidence path: 6bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 6.6 GB | 9k | Estimated | $3,499 | 6bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 6.6 GB headroom remains at this quantization. |
| 15 | Mac Studio M4 Max 48GB | 149 | 8bit | 18.0 tok/s Fastest evidence path: 8bit · 18.0 tok/s · MLX · Estimated | MLX | Fits | 11.4 GB | 13k | Estimated | $2,499 | 8bit is the current best practical quantization. 18.0 tok/s is estimated from nearby benchmark coverage. 11.4 GB headroom remains at this quantization. |
| 16 | MacBook Pro M4 Max 48GB 14-inch | 149 | 8bit | 18.0 tok/s Fastest evidence path: 8bit · 18.0 tok/s · MLX · Estimated | MLX | Fits | 11.4 GB | 13k | Estimated | $3,499 | 8bit is the current best practical quantization. 18.0 tok/s is estimated from nearby benchmark coverage. 11.4 GB headroom remains at this quantization. |
| 17 | MacBook Pro M4 Max 48GB 16-inch | 149 | 8bit | 18.0 tok/s Fastest evidence path: 8bit · 18.0 tok/s · MLX · Estimated | MLX | Fits | 11.4 GB | 13k | Estimated | $3,999 | 8bit is the current best practical quantization. 18.0 tok/s is estimated from nearby benchmark coverage. 11.4 GB headroom remains at this quantization. |
| 18 | Mac Mini M4 32GB | 148 | 5bit | 22.0 tok/s Fastest evidence path: 5bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 6.1 GB | 10k | Estimated | $799 | 5bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 6.1 GB headroom remains at this quantization. |
| 19 | MacBook Air M4 32GB 13-inch | 148 | 5bit | 22.0 tok/s Fastest evidence path: 5bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 6.1 GB | 10k | Estimated | $1,499 | 5bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 6.1 GB headroom remains at this quantization. |
| 20 | MacBook Air M4 32GB 15-inch | 148 | 5bit | 22.0 tok/s Fastest evidence path: 5bit · 22.0 tok/s · MLX · Estimated | MLX | Fits | 6.1 GB | 10k | Estimated | $1,699 | 5bit is the current best practical quantization. 22.0 tok/s is estimated from nearby benchmark coverage. 6.1 GB headroom remains at this quantization. |
| 21 | Mac Mini M4 24GB | 85 | 3bit | 14.0 tok/s Fastest evidence path: 3bit · 14.0 tok/s · Ollama · Estimated | Ollama | Fits | 5.3 GB | 10k | Estimated | $599 | 3bit is the current best practical quantization. 14.0 tok/s is estimated from nearby benchmark coverage. 5.3 GB headroom remains at this quantization. |
| 22 | MacBook Air M4 24GB 13-inch | 85 | 3bit | 14.0 tok/s Fastest evidence path: 3bit · 14.0 tok/s · Ollama · Estimated | Ollama | Fits | 5.3 GB | 10k | Estimated | $1,299 | 3bit is the current best practical quantization. 14.0 tok/s is estimated from nearby benchmark coverage. 5.3 GB headroom remains at this quantization. |
| 23 | Mac Mini M4 Pro 24GB | 85 | 3bit | 14.0 tok/s Fastest evidence path: 3bit · 14.0 tok/s · Ollama · Estimated | Ollama | Fits | 5.3 GB | 10k | Estimated | $1,399 | 3bit is the current best practical quantization. 14.0 tok/s is estimated from nearby benchmark coverage. 5.3 GB headroom remains at this quantization. |
| 24 | MacBook Air M4 24GB 15-inch | 85 | 3bit | 14.0 tok/s Fastest evidence path: 3bit · 14.0 tok/s · Ollama · Estimated | Ollama | Fits | 5.3 GB | 10k | Estimated | $1,499 | 3bit is the current best practical quantization. 14.0 tok/s is estimated from nearby benchmark coverage. 5.3 GB headroom remains at this quantization. |
| 25 | MacBook Pro M4 Pro 24GB 14-inch | 85 | 3bit | 14.0 tok/s Fastest evidence path: 3bit · 14.0 tok/s · Ollama · Estimated | Ollama | Fits | 5.3 GB | 10k | Estimated | $1,999 | 3bit is the current best practical quantization. 14.0 tok/s is estimated from nearby benchmark coverage. 5.3 GB headroom remains at this quantization. |
| 26 | MacBook Pro M4 Pro 24GB 16-inch | 85 | 3bit | 14.0 tok/s Fastest evidence path: 3bit · 14.0 tok/s · Ollama · Estimated | Ollama | Fits | 5.3 GB | 10k | Estimated | $2,499 | 3bit is the current best practical quantization. 14.0 tok/s is estimated from nearby benchmark coverage. 5.3 GB headroom remains at this quantization. |
| 27 | Mac Mini M4 16GB | 0 | F32 | — | MLX | No | -106.4 GB | — | Estimated | $499 | Gemma 4 31B does not fit on Mac Mini M4 16GB at the current practical quantization. |
| 28 | MacBook Air M4 16GB 13-inch | 0 | F32 | — | MLX | No | -106.4 GB | — | Estimated | $1,099 | Gemma 4 31B does not fit on MacBook Air M4 16GB 13-inch at the current practical quantization. |
| 29 | MacBook Air M4 16GB 15-inch | 0 | F32 | — | MLX | No | -106.4 GB | — | Estimated | $1,299 | Gemma 4 31B does not fit on MacBook Air M4 16GB 15-inch at the current practical quantization. |