Hardware spec
A100 40GB
NVIDIA · Ampere · sm_80
- vram
- 40 GB
- bandwidth
- 1,555 GB/s
- tdp
- 400 W
- released
- 2020-05-14
- msrp
- $11,000
- street
- ~$8,000
★ Sweet spot for this card
Q8_0 · GGUF · 28.9 GB
bench50.6 · conf A
vram28.9 / 40 GB
speed54 tok/s
Best benchmark per GB of VRAM in your tier. Q8_0wastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →Showing 10 of 16 models that fit ·
see full ranked list →★ Best value
48 GB · ~$4,200 · +$-3,800 over A100 40GB
Unlocks +1 models not in current rank
See A6000 Pro →Bigger tier
48 GB · ~$7,000 · +$-1,000 over A100 40GB
Unlocks +1 models not in current rank
See RTX 6000 Ada →Premium tier
80 GB · ~$28,000 · +$20,000 over A100 40GB
Unlocks +2 models not in current rank
See H100 PCIe →Not running a A100 40GB?
Tell us what you actually have — we'll re-rank everything for your machine.