what/llm/can/i/run
gpus/apple/m2-ultra-192gb

M2 Ultra 192GB

Released 2023-06-13 · Street $6,200
vram
192 GB
unified mem
bandwidth
800
GB/s
models fit
20
top · FP16
power
120 W
low

▸Spec sheet · top pick

Hardware spec
M2 Ultra 192GB
Apple · Apple Silicon · M2
vram
192 GB unified
bandwidth
800 GB/s
tdp
120 W
released
2023-06-13
msrp
$6,599
street
~$6,200
★ Sweet spot for this card
gemma 3 27b
FP16 · GGUF · 57.2 GB
bench50.6 · conf A
vram57.2 / 192 GB
speed14 tok/s
Best benchmark per GB of VRAM in your tier. FP16wastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →

▸Top 10 models on this GPU

#modelquantvramtok/sbench ↓fit
01gemma 3 27bFP1657.2 GB1450.6Great
02Qwen2.5 Coder 32BFP1667.7 GB1248.8Great
03Gemma 2 27BFP1657.2 GB1446.2Great
04Llama 4 Maverick 17B 128EQ2_K158 GB559.3Great
05Qwen3 32BFP1667.7 GB1240.0Great
06Gemma 2 9BFP1619.4 GB4135.0Great
07Gemma 3 12BFP1625.7 GB3131.3Great
08deepseek r1 distill llama 70bFP16147.5 GB551.7Great
09deepseek r1 distill qwen 32bFP1667.7 GB1233.3Great
10Gemma 3 4BFP168.9 GB9015.1Great
Showing 10 of 20 models that fit · see full ranked list →

▸Upgrade options

★ Best value
+M3 Ultra 256GB
256 GB · ~$7,099 · +$899 over M2 Ultra 192GB
Same model set · higher headroom for context / batch
See M3 Ultra 256GB →
Bigger tier
+M3 Ultra 512GB
512 GB · ~$9,499 · +$3,299 over M2 Ultra 192GB
Unlocks +2 models not in current rank
See M3 Ultra 512GB →

▸Also compare

M3 Ultra 192GB
192 GB · Apple unified · 10% cheaper
MI300X
192 GB · AMD · 142% more
Not running a M2 Ultra 192GB?
Tell us what you actually have — we'll re-rank everything for your machine.
Change my machine