Hardware spec
H100 SXM5
NVIDIA · Hopper · sm_90
- vram
- 80 GB
- bandwidth
- 3,350 GB/s
- tdp
- 700 W
- released
- 2022-03-22
- msrp
- $40,000
- street
- ~$40,000
★ Sweet spot for this card
FP16 · GGUF · 57.2 GB
bench50.6 · conf A
vram57.2 / 80 GB
speed59 tok/s
Best benchmark per GB of VRAM in your tier. FP16wastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →Showing 10 of 18 models that fit ·
see full ranked list →★ Best value
141 GB · ~$45,000 · +$5,000 over H100 SXM5
Unlocks +1 models not in current rank
See H200 SXM5 →Bigger tier
128 GB · ~$4,000 · +$-36,000 over H100 SXM5
Unlocks +1 models not in current rank
See M1 Ultra 128GB →Premium tier
96 GB · ~$3,500 · +$-36,500 over H100 SXM5
Same model set · higher headroom for context / batch
See M2 Max 96GB →Not running a H100 SXM5?
Tell us what you actually have — we'll re-rank everything for your machine.