what/llm/can/i/run
gpus/nvidia/rtx-6000-ada

RTX 6000 Ada

Released 2022-12-13 · Street $7,000
vram
48 GB
discrete
bandwidth
960
GB/s
models fit
17
top · Q8_0
power
300 W
medium

▸Spec sheet · top pick

Hardware spec
RTX 6000 Ada
NVIDIA · Ada Lovelace · sm_89
vram
48 GB
bandwidth
960 GB/s
tdp
300 W
released
2022-12-13
msrp
$6,800
street
~$7,000
★ Sweet spot for this card
gemma 3 27b
Q8_0 · GGUF · 28.9 GB
bench50.6 · conf A
vram28.9 / 48 GB
speed33 tok/s
Best benchmark per GB of VRAM in your tier. Q8_0wastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →

▸Top 10 models on this GPU

#modelquantvramtok/sbench ↓fit
01gemma 3 27bQ8_028.9 GB3350.6Great
02Qwen2.5 Coder 32BQ8_034.1 GB2848.8Great
03Gemma 2 27BQ8_028.9 GB3346.2Great
04Qwen3 32BQ8_034.1 GB2840.0Great
05Gemma 2 9BFP1619.4 GB4935.0Great
06deepseek r1 distill llama 70bQ5_K_M46.4 GB2151.7Tight
07Gemma 3 12BFP1625.7 GB3731.3Great
08deepseek r1 distill qwen 32bQ8_034.1 GB2833.3Great
09Gemma 3 4BFP168.9 GB10815.1Great
10Mixtral 8x7B v0.1Q6_K37.3 GB2613.3Great
Showing 10 of 17 models that fit · see full ranked list →

▸Upgrade options

★ Best value
+H100 PCIe
80 GB · ~$28,000 · +$21,000 over RTX 6000 Ada
Unlocks +1 models not in current rank
See H100 PCIe →
Bigger tier
+H100 SXM5
80 GB · ~$40,000 · +$33,000 over RTX 6000 Ada
Unlocks +1 models not in current rank
See H100 SXM5 →
Premium tier
+H200 SXM5
141 GB · ~$45,000 · +$38,000 over RTX 6000 Ada
Unlocks +2 models not in current rank
See H200 SXM5 →

▸Also compare

RTX 5090
32 GB · NVIDIA · 66% cheaper
A6000 Pro
48 GB · NVIDIA · 40% cheaper
A100 40GB
40 GB · NVIDIA · 14% more
L40S
48 GB · NVIDIA · 21% more
Not running a RTX 6000 Ada?
Tell us what you actually have — we'll re-rank everything for your machine.
Change my machine