Hardware spec
RTX 4090
NVIDIA · Ada Lovelace · sm_89
- vram
- 24 GB
- bandwidth
- 1,008 GB/s
- tdp
- 450 W
- released
- 2022-10-12
- msrp
- $1,599
- street
- ~$1,899
★ Sweet spot for this card
Q6_K · GGUF · 21.8 GB
bench50.6 · conf A
vram21.8 / 24 GB
speed46 tok/s
Best benchmark per GB of VRAM in your tier. Q6_Kwastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →Showing 10 of 13 models that fit ·
see full ranked list →★ Best value
32 GB · ~$2,399 · +$500 over RTX 4090
Unlocks +3 models not in current rank
See RTX 5090 →Bigger tier
48 GB · ~$4,200 · +$2,301 over RTX 4090
Unlocks +4 models not in current rank
See A6000 Pro →Premium tier
48 GB · ~$7,000 · +$5,101 over RTX 4090
Unlocks +4 models not in current rank
See RTX 6000 Ada →Not running a RTX 4090?
Tell us what you actually have — we'll re-rank everything for your machine.