Hardware spec
H100 PCIe
NVIDIA · Hopper · sm_90
- vram
- 80 GB
- bandwidth
- 2,000 GB/s
- tdp
- 350 W
- released
- 2022-03-22
- msrp
- $30,000
- street
- ~$28,000
★ Sweet spot for this card
FP16 · GGUF · 57.2 GB
bench50.6 · conf A
vram57.2 / 80 GB
speed35 tok/s
Best benchmark per GB of VRAM in your tier. FP16wastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →Showing 10 of 18 models that fit ·
see full ranked list →★ Best value
141 GB · ~$45,000 · +$17,000 over H100 PCIe
Unlocks +1 models not in current rank
See H200 SXM5 →Bigger tier
128 GB · ~$4,000 · +$-24,000 over H100 PCIe
Unlocks +1 models not in current rank
See M1 Ultra 128GB →Premium tier
96 GB · ~$3,500 · +$-24,500 over H100 PCIe
Same model set · higher headroom for context / batch
See M2 Max 96GB →Not running a H100 PCIe?
Tell us what you actually have — we'll re-rank everything for your machine.