what/llm/can/i/run
gpus/nvidia/rtx-4060-ti-8gb

RTX 4060 Ti 8GB

Released 2023-05-24 · Street $379
vram
8 GB
discrete
bandwidth
288
GB/s
models fit
5
top · Q4_K_M
power
160 W
low

Spec sheet · top pick

Hardware spec
RTX 4060 Ti 8GB
NVIDIA · Ada Lovelace · sm_89
vram
8 GB
bandwidth
288 GB/s
tdp
160 W
released
2023-05-24
msrp
$399
street
~$379
★ Sweet spot for this card
Gemma 3 12B
Q4_K_M · GGUF · 6.8 GB
bench31.3 · conf B
vram6.8 / 8 GB
speed42 tok/s
Best benchmark per GB of VRAM in your tier. Q4_K_Mwastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →

Top 5 models on this GPU

#modelquantvramtok/sbench ↓fit
01Gemma 3 12BQ4_K_M6.8 GB4231.3Great
02Gemma 2 9BQ6_K7.6 GB3835.0Ok
03Gemma 3 4BQ8_04.7 GB6115.1Great
04Gemma 2 2bFP164.7 GB610.0Great
05Meta Llama 3.1 8BQ6_K6.8 GB420.0Great
Showing 5 of 5 models that fit · see full ranked list →

Upgrade options

★ Best value
+RTX 5090
32 GB · ~$2,399 · +$2,020 over RTX 4060 Ti 8GB
Unlocks +11 models not in current rank · top-pick bench +19.3
See RTX 5090
Bigger tier
+RTX 5080
16 GB · ~$1,099 · +$720 over RTX 4060 Ti 8GB
Unlocks +7 models not in current rank · top-pick bench +19.3
See RTX 5080
Premium tier
+RTX 5070 Ti
16 GB · ~$849 · +$470 over RTX 4060 Ti 8GB
Unlocks +7 models not in current rank · top-pick bench +19.3
See RTX 5070 Ti

Also compare

RTX 5080
16 GB · NVIDIA · 190% more
RTX 5070 Ti
16 GB · NVIDIA · 124% more
RTX 5070
12 GB · NVIDIA · 58% more
RTX 5060 Ti 16GB
16 GB · NVIDIA · 18% more
Not running a RTX 4060 Ti 8GB?
Tell us what you actually have — we'll re-rank everything for your machine.
Change my machine