Hardware spec
A100 80GB
NVIDIA · Ampere · sm_80
- vram
- 80 GB
- bandwidth
- 1,935 GB/s
- tdp
- 400 W
- released
- 2020-11-16
- msrp
- $15,000
- street
- ~$11,000
★ Sweet spot for this card
FP16 · GGUF · 57.2 GB
bench50.6 · conf A
vram57.2 / 80 GB
speed34 tok/s
Best benchmark per GB of VRAM in your tier. FP16wastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →Showing 10 of 18 models that fit ·
see full ranked list →★ Best value
141 GB · ~$45,000 · +$34,000 over A100 80GB
Unlocks +1 models not in current rank
See H200 SXM5 →Bigger tier
128 GB · ~$4,000 · +$-7,000 over A100 80GB
Unlocks +1 models not in current rank
See M1 Ultra 128GB →Premium tier
96 GB · ~$3,500 · +$-7,500 over A100 80GB
Same model set · higher headroom for context / batch
See M2 Max 96GB →Not running a A100 80GB?
Tell us what you actually have — we'll re-rank everything for your machine.