what/llm/can/i/run
gpus/nvidia/rtx-3060-12gb

RTX 3060 12GB

Released 2021-02-25 · Street $280
vram
12 GB
discrete
bandwidth
360
GB/s
models fit
7
top · Q2_K
power
170 W
low

Spec sheet · top pick

Hardware spec
RTX 3060 12GB
NVIDIA · Ampere · sm_86
vram
12 GB
bandwidth
360 GB/s
tdp
170 W
released
2021-02-25
msrp
$329
street
~$280
★ Sweet spot for this card
gemma 3 27b
Q2_K · GGUF · 11.1 GB
bench50.6 · conf A
vram11.1 / 12 GB
speed32 tok/s
Best benchmark per GB of VRAM in your tier. Q2_Kwastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →

Top 7 models on this GPU

#modelquantvramtok/sbench ↓fit
01gemma 3 27bQ2_K11.1 GB3250.6Ok
02Gemma 2 27BQ2_K11.1 GB3246.2Ok
03Gemma 2 9BQ8_010 GB3635.0Great
04Gemma 3 12BQ6_K10 GB3631.3Great
05Gemma 3 4BFP168.9 GB4015.1Great
06Gemma 2 2bFP164.7 GB770.0Great
07Meta Llama 3.1 8BQ8_08.9 GB400.0Great
Showing 7 of 7 models that fit · see full ranked list →

Upgrade options

★ Best value
+RTX 5090
32 GB · ~$2,399 · +$2,119 over RTX 3060 12GB
Unlocks +9 models not in current rank
See RTX 5090
Bigger tier
+RTX 5080
16 GB · ~$1,099 · +$819 over RTX 3060 12GB
Unlocks +5 models not in current rank
See RTX 5080
Premium tier
+RTX 5070 Ti
16 GB · ~$849 · +$569 over RTX 3060 12GB
Unlocks +5 models not in current rank
See RTX 5070 Ti

Also compare

RTX 5080
16 GB · NVIDIA · 293% more
RTX 5070 Ti
16 GB · NVIDIA · 203% more
RTX 5070
12 GB · NVIDIA · 114% more
RTX 5060 Ti 16GB
16 GB · NVIDIA · 60% more
Not running a RTX 3060 12GB?
Tell us what you actually have — we'll re-rank everything for your machine.
Change my machine