Hardware spec
RTX 3070
NVIDIA · Ampere · sm_86
- vram
- 8 GB
- bandwidth
- 448 GB/s
- tdp
- 220 W
- released
- 2020-10-29
- msrp
- $499
- street
- ~$349
★ Sweet spot for this card
Q6_K · GGUF · 7.6 GB
bench35.0 · conf B
vram7.6 / 8 GB
speed59 tok/s
Best benchmark per GB of VRAM in your tier. Q6_Kwastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →Showing 5 of 5 models that fit ·
see full ranked list →★ Best value
32 GB · ~$2,399 · +$2,050 over RTX 3070
Unlocks +11 models not in current rank · top-pick bench +15.6
See RTX 5090 →Bigger tier
16 GB · ~$1,099 · +$750 over RTX 3070
Unlocks +7 models not in current rank · top-pick bench +15.6
See RTX 5080 →Premium tier
16 GB · ~$849 · +$500 over RTX 3070
Unlocks +7 models not in current rank · top-pick bench +15.6
See RTX 5070 Ti →Not running a RTX 3070?
Tell us what you actually have — we'll re-rank everything for your machine.
Change my machine