what/llm/can/i/run
gpus/apple/m1-ultra-64gb

M1 Ultra 64GB

Released 2022-03-08 · Street $2,500
vram
64 GB
unified mem
bandwidth
800
GB/s
models fit
18
top · Q8_0
power
120 W
low

Spec sheet · top pick

Hardware spec
M1 Ultra 64GB
Apple · Apple Silicon · M1
vram
64 GB unified
bandwidth
800 GB/s
tdp
120 W
released
2022-03-08
msrp
$3,999
street
~$2,500
★ Sweet spot for this card
Qwen2.5 Coder 32B
Q8_0 · GGUF · 34.1 GB
bench48.8 · conf A
vram34.1 / 64 GB
speed23 tok/s
Best benchmark per GB of VRAM in your tier. Q8_0wastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →

Top 10 models on this GPU

#modelquantvramtok/sbench ↓fit
01Qwen2.5 Coder 32BQ8_034.1 GB2348.8Great
02gemma 3 27bFP1657.2 GB1450.6Ok
03Qwen3 32BQ8_034.1 GB2340.0Great
04Gemma 2 27BFP1657.2 GB1446.2Ok
05Gemma 2 9BFP1619.4 GB4135.0Great
06deepseek r1 distill llama 70bQ6_K55.6 GB1451.7Ok
07Gemma 3 12BFP1625.7 GB3131.3Great
08deepseek r1 distill qwen 32bQ8_034.1 GB2333.3Great
09Gemma 3 4BFP168.9 GB9015.1Great
10Mixtral 8x22b v0.1Q2_K56 GB1420.0Ok
Showing 10 of 18 models that fit · see full ranked list →

Upgrade options

★ Best value
+H100 PCIe
80 GB · ~$28,000 · +$25,500 over M1 Ultra 64GB
Same model set · higher headroom for context / batch · top-pick bench +1.8
See H100 PCIe
Bigger tier
+H100 SXM5
80 GB · ~$40,000 · +$37,500 over M1 Ultra 64GB
Same model set · higher headroom for context / batch · top-pick bench +1.8
See H100 SXM5
Premium tier
+H200 SXM5
141 GB · ~$45,000 · +$42,500 over M1 Ultra 64GB
Unlocks +1 models not in current rank · top-pick bench +1.8
See H200 SXM5

Also compare

A6000 Pro
48 GB · NVIDIA · 68% more
RTX 6000 Ada
48 GB · NVIDIA · 180% more
H100 PCIe
80 GB · NVIDIA · 1020% more
H100 SXM5
80 GB · NVIDIA · 1500% more
Not running a M1 Ultra 64GB?
Tell us what you actually have — we'll re-rank everything for your machine.
Change my machine