what/llm/can/i/run
gpus/apple/m2-max-32gb

M2 Max 32GB

Released 2023-01-17 · Street $2,400
vram
32 GB
unified mem
bandwidth
400
GB/s
models fit
16
top · Q8_0
power
78 W
low

Spec sheet · top pick

Hardware spec
M2 Max 32GB
Apple · Apple Silicon · M2
vram
32 GB unified
bandwidth
400 GB/s
tdp
78 W
released
2023-01-17
msrp
$3,099
street
~$2,400
★ Sweet spot for this card
gemma 3 27b
Q8_0 · GGUF · 28.9 GB
bench50.6 · conf A
vram28.9 / 32 GB
speed14 tok/s
Best benchmark per GB of VRAM in your tier. Q8_0wastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →

Top 10 models on this GPU

#modelquantvramtok/sbench ↓fit
01gemma 3 27bQ8_028.9 GB1450.6Ok
02Qwen2.5 Coder 32BQ6_K25.7 GB1648.8Great
03Gemma 2 27BQ8_028.9 GB1446.2Ok
04Qwen3 32BQ6_K25.7 GB1640.0Great
05Gemma 2 9BFP1619.4 GB2135.0Great
06deepseek r1 distill llama 70bQ2_K28.1 GB1451.7Ok
07Gemma 3 12BFP1625.7 GB1631.3Great
08deepseek r1 distill qwen 32bQ6_K25.7 GB1633.3Great
09Gemma 3 4BFP168.9 GB4515.1Great
10Mixtral 8x7B v0.1Q4_K_M25 GB1613.3Great
Showing 10 of 16 models that fit · see full ranked list →

Upgrade options

★ Best value
+A6000 Pro
48 GB · ~$4,200 · +$1,800 over M2 Max 32GB
Unlocks +1 models not in current rank
See A6000 Pro
Bigger tier
+RTX 6000 Ada
48 GB · ~$7,000 · +$4,600 over M2 Max 32GB
Unlocks +1 models not in current rank
See RTX 6000 Ada
Premium tier
+H100 PCIe
80 GB · ~$28,000 · +$25,600 over M2 Max 32GB
Unlocks +2 models not in current rank
See H100 PCIe

Also compare

RTX 5090
32 GB · NVIDIA · 0% cheaper
RTX 5080
16 GB · NVIDIA · 54% cheaper
RTX 5070 Ti
16 GB · NVIDIA · 65% cheaper
RTX 5060 Ti 16GB
16 GB · NVIDIA · 81% cheaper
Not running a M2 Max 32GB?
Tell us what you actually have — we'll re-rank everything for your machine.
Change my machine