what/llm/can/i/run
gpus/nvidia/a6000-pro

A6000 Pro

Released 2021-04-12 · Street $4,200
vram
48 GB
discrete
bandwidth
768
GB/s
models fit
17
top · Q8_0
power
300 W
medium

▸Spec sheet · top pick

Hardware spec
A6000 Pro
NVIDIA · Ampere · sm_86
vram
48 GB
bandwidth
768 GB/s
tdp
300 W
released
2021-04-12
msrp
$4,650
street
~$4,200
★ Sweet spot for this card
gemma 3 27b
Q8_0 · GGUF · 28.9 GB
bench50.6 · conf A
vram28.9 / 48 GB
speed27 tok/s
Best benchmark per GB of VRAM in your tier. Q8_0wastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →

▸Top 10 models on this GPU

#modelquantvramtok/sbench ↓fit
01gemma 3 27bQ8_028.9 GB2750.6Great
02Qwen2.5 Coder 32BQ8_034.1 GB2348.8Great
03Gemma 2 27BQ8_028.9 GB2746.2Great
04Qwen3 32BQ8_034.1 GB2340.0Great
05Gemma 2 9BFP1619.4 GB4035.0Great
06Gemma 3 12BFP1625.7 GB3031.3Great
07deepseek r1 distill llama 70bQ5_K_M46.4 GB1751.7Tight
08deepseek r1 distill qwen 32bQ8_034.1 GB2333.3Great
09Gemma 3 4BFP168.9 GB8615.1Great
10Mixtral 8x7B v0.1Q6_K37.3 GB2113.3Great
Showing 10 of 17 models that fit · see full ranked list →

▸Upgrade options

★ Best value
+H100 PCIe
80 GB · ~$28,000 · +$23,800 over A6000 Pro
Unlocks +1 models not in current rank
See H100 PCIe →
Bigger tier
+H100 SXM5
80 GB · ~$40,000 · +$35,800 over A6000 Pro
Unlocks +1 models not in current rank
See H100 SXM5 →
Premium tier
+H200 SXM5
141 GB · ~$45,000 · +$40,800 over A6000 Pro
Unlocks +2 models not in current rank
See H200 SXM5 →

▸Also compare

RTX 5090
32 GB · NVIDIA · 43% cheaper
RTX 6000 Ada
48 GB · NVIDIA · 67% more
A100 40GB
40 GB · NVIDIA · 90% more
L40S
48 GB · NVIDIA · 102% more
Not running a A6000 Pro?
Tell us what you actually have — we'll re-rank everything for your machine.
Change my machine