Hardware spec
H200 SXM5
NVIDIA · Hopper · sm_90
- vram
- 141 GB
- bandwidth
- 4,800 GB/s
- tdp
- 700 W
- released
- 2024-03-27
- msrp
- $45,000
- street
- ~$45,000
★ Sweet spot for this card
FP16 · GGUF · 57.2 GB
bench50.6 · conf A
vram57.2 / 141 GB
speed84 tok/s
Best benchmark per GB of VRAM in your tier. FP16wastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →Showing 10 of 19 models that fit ·
see full ranked list →★ Best value
192 GB · ~$6,200 · +$-38,800 over H200 SXM5
Unlocks +1 models not in current rank
See M2 Ultra 192GB →Bigger tier
192 GB · ~$5,599 · +$-39,401 over H200 SXM5
Unlocks +1 models not in current rank
See M3 Ultra 192GB →Premium tier
256 GB · ~$7,099 · +$-37,901 over H200 SXM5
Unlocks +1 models not in current rank
See M3 Ultra 256GB →Not running a H200 SXM5?
Tell us what you actually have — we'll re-rank everything for your machine.