what/llm/can/i/run
gpus/nvidia/rtx-5090

RTX 5090

Released 2025-01-30 · Street $2,399
vram
32 GB
discrete
bandwidth
1,792
GB/s
models fit
16
top · Q8_0
power
575 W
high

Spec sheet · top pick

Hardware spec
RTX 5090
NVIDIA · Blackwell · sm_120
vram
32 GB
bandwidth
1,792 GB/s
tdp
575 W
released
2025-01-30
msrp
$1,999
street
~$2,399
★ Sweet spot for this card
gemma 3 27b
Q8_0 · GGUF · 28.9 GB
bench50.6 · conf A
vram28.9 / 32 GB
speed62 tok/s
Best benchmark per GB of VRAM in your tier. Q8_0wastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →

Top 10 models on this GPU

#modelquantvramtok/sbench ↓fit
01gemma 3 27bQ8_028.9 GB6250.6Ok
02Qwen2.5 Coder 32BQ6_K25.7 GB7048.8Great
03Gemma 2 27BQ8_028.9 GB6246.2Ok
04Qwen3 32BQ6_K25.7 GB7040.0Great
05Gemma 2 9BFP1619.4 GB9235.0Great
06deepseek r1 distill llama 70bQ2_K28.1 GB6451.7Ok
07Gemma 3 12BFP1625.7 GB7031.3Great
08deepseek r1 distill qwen 32bQ6_K25.7 GB7033.3Great
09Gemma 3 4BFP168.9 GB20115.1Great
10Mixtral 8x7B v0.1Q4_K_M25 GB7213.3Great
Showing 10 of 16 models that fit · see full ranked list →

Upgrade options

★ Best value
+A6000 Pro
48 GB · ~$4,200 · +$1,801 over RTX 5090
Unlocks +1 models not in current rank
See A6000 Pro
Bigger tier
+RTX 6000 Ada
48 GB · ~$7,000 · +$4,601 over RTX 5090
Unlocks +1 models not in current rank
See RTX 6000 Ada
Premium tier
+H100 PCIe
80 GB · ~$28,000 · +$25,601 over RTX 5090
Unlocks +2 models not in current rank
See H100 PCIe

Also compare

RTX 5080
16 GB · NVIDIA · 54% cheaper
RTX 5070 Ti
16 GB · NVIDIA · 65% cheaper
RTX 5060 Ti 16GB
16 GB · NVIDIA · 81% cheaper
RTX 4090
24 GB · NVIDIA · 21% cheaper
Not running a RTX 5090?
Tell us what you actually have — we'll re-rank everything for your machine.
Change my machine