what/llm/can/i/run
gpus/apple/m4-max-36gb

M4 Max 36GB

Released 2024-10-30 · Street $3,199
vram
36 GB
unified mem
bandwidth
410
GB/s
models fit
16
top · Q8_0
power
78 W
low

Spec sheet · top pick

Hardware spec
M4 Max 36GB
Apple · Apple Silicon · M4
vram
36 GB unified
bandwidth
410 GB/s
tdp
78 W
released
2024-10-30
msrp
$3,199
street
~$3,199
★ Sweet spot for this card
gemma 3 27b
Q8_0 · GGUF · 28.9 GB
bench50.6 · conf A
vram28.9 / 36 GB
speed14 tok/s
Best benchmark per GB of VRAM in your tier. Q8_0wastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →

Top 10 models on this GPU

#modelquantvramtok/sbench ↓fit
01gemma 3 27bQ8_028.9 GB1450.6Great
02Qwen2.5 Coder 32BQ8_034.1 GB1248.8Ok
03Gemma 2 27BQ8_028.9 GB1446.2Great
04Gemma 2 9BFP1619.4 GB2135.0Great
05Qwen3 32BQ8_034.1 GB1240.0Ok
06deepseek r1 distill llama 70bQ2_K28.1 GB1551.7Great
07Gemma 3 12BFP1625.7 GB1631.3Great
08deepseek r1 distill qwen 32bQ8_034.1 GB1233.3Ok
09Gemma 3 4BFP168.9 GB4615.1Great
10Mixtral 8x7B v0.1Q5_K_M31.1 GB1313.3Ok
Showing 10 of 16 models that fit · see full ranked list →

Upgrade options

★ Best value
+A6000 Pro
48 GB · ~$4,200 · +$1,001 over M4 Max 36GB
Unlocks +1 models not in current rank
See A6000 Pro
Bigger tier
+RTX 6000 Ada
48 GB · ~$7,000 · +$3,801 over M4 Max 36GB
Unlocks +1 models not in current rank
See RTX 6000 Ada
Premium tier
+H100 PCIe
80 GB · ~$28,000 · +$24,801 over M4 Max 36GB
Unlocks +2 models not in current rank
See H100 PCIe

Also compare

RTX 5090
32 GB · NVIDIA · 25% cheaper
RTX 4090
24 GB · NVIDIA · 41% cheaper
RTX 3090 Ti
24 GB · NVIDIA · 70% cheaper
RTX 3090
24 GB · NVIDIA · 72% cheaper
Not running a M4 Max 36GB?
Tell us what you actually have — we'll re-rank everything for your machine.
Change my machine