Hardware spec
RTX 3090
NVIDIA · Ampere · sm_86
- vram
- 24 GB
- bandwidth
- 936 GB/s
- tdp
- 350 W
- released
- 2020-09-24
- msrp
- $1,499
- street
- ~$900
★ Sweet spot for this card
Q6_K · GGUF · 21.8 GB
bench50.6 · conf A
vram21.8 / 24 GB
speed43 tok/s
Best benchmark per GB of VRAM in your tier. Q6_Kwastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →Showing 10 of 13 models that fit ·
see full ranked list →★ Best value
32 GB · ~$2,399 · +$1,499 over RTX 3090
Unlocks +3 models not in current rank
See RTX 5090 →Bigger tier
48 GB · ~$4,200 · +$3,300 over RTX 3090
Unlocks +4 models not in current rank
See A6000 Pro →Premium tier
48 GB · ~$7,000 · +$6,100 over RTX 3090
Unlocks +4 models not in current rank
See RTX 6000 Ada →Not running a RTX 3090?
Tell us what you actually have — we'll re-rank everything for your machine.