what/llm/can/i/run
gpus/nvidia/rtx-3080-10gb

RTX 3080 10GB

Released 2020-09-17 · Street $449
vram
10 GB
discrete
bandwidth
760
GB/s
models fit
5
top · Q6_K
power
320 W
medium

Spec sheet · top pick

Hardware spec
RTX 3080 10GB
NVIDIA · Ampere · sm_86
vram
10 GB
bandwidth
760 GB/s
tdp
320 W
released
2020-09-17
msrp
$699
street
~$449
★ Sweet spot for this card
Gemma 2 9B
Q6_K · GGUF · 7.6 GB
bench35.0 · conf B
vram7.6 / 10 GB
speed100 tok/s
Best benchmark per GB of VRAM in your tier. Q6_Kwastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →

Top 5 models on this GPU

#modelquantvramtok/sbench ↓fit
01Gemma 2 9BQ6_K7.6 GB10035.0Great
02Gemma 3 12BQ5_K_M8.4 GB9131.3Great
03Gemma 3 4BFP168.9 GB8515.1Ok
04Gemma 2 2bFP164.7 GB1620.0Great
05Meta Llama 3.1 8BQ8_08.9 GB850.0Ok
Showing 5 of 5 models that fit · see full ranked list →

Upgrade options

★ Best value
+RTX 5090
32 GB · ~$2,399 · +$1,950 over RTX 3080 10GB
Unlocks +11 models not in current rank · top-pick bench +15.6
See RTX 5090
Bigger tier
+RTX 5080
16 GB · ~$1,099 · +$650 over RTX 3080 10GB
Unlocks +7 models not in current rank · top-pick bench +15.6
See RTX 5080
Premium tier
+RTX 5070 Ti
16 GB · ~$849 · +$400 over RTX 3080 10GB
Unlocks +7 models not in current rank · top-pick bench +15.6
See RTX 5070 Ti

Also compare

RTX 5080
16 GB · NVIDIA · 145% more
RTX 5070 Ti
16 GB · NVIDIA · 89% more
RTX 5070
12 GB · NVIDIA · 33% more
RTX 5060 Ti 16GB
16 GB · NVIDIA · 0% more
Not running a RTX 3080 10GB?
Tell us what you actually have — we'll re-rank everything for your machine.
Change my machine