what/llm/can/i/run

Compare GPUs for Local LLMs

Adjacent-tier comparisons and cross-architecture matchups. Each page shows spec diff, which models the upgrade unlocks, speed deltas on shared models, and an honest value verdict.

Adjacent NVIDIA tier

RTX 5060 vs RTX 4060 Ti 8GB
8 GB → 8 GB · +$60
RTX 4060 Ti 8GB vs RTX 4060
8 GB → 8 GB · +$-90
RTX 4060 vs RTX 3070 Ti
8 GB → 8 GB · +$110
RTX 3070 Ti vs RTX 3070
8 GB → 8 GB · +$-50
RTX 3070 vs RTX 3060 Ti
8 GB → 8 GB · +$-40
RTX 3060 Ti vs RTX 3060 8GB
8 GB → 8 GB · +$-60
RTX 3060 8GB vs RTX 3050 8GB
8 GB → 8 GB · +$-30
RTX 3050 8GB vs RTX 2080 SUPER
8 GB → 8 GB · +$1
RTX 2080 SUPER vs RTX 3080 10GB
8 GB → 10 GB · +$229
RTX 3080 10GB vs RTX 2080 Ti
10 GB → 11 GB · +$-150
RTX 2080 Ti vs RTX 5070
11 GB → 12 GB · +$300
RTX 5070 vs RTX 4070 Ti
12 GB → 12 GB · +$151
RTX 4070 Ti vs RTX 4070 SUPER
12 GB → 12 GB · +$-121
RTX 4070 SUPER vs RTX 4070
12 GB → 12 GB · +$-80
RTX 4070 vs RTX 3080 Ti
12 GB → 12 GB · +$100
RTX 3080 Ti vs RTX 3080 12GB
12 GB → 12 GB · +$-100
RTX 3080 12GB vs RTX 3060 12GB
12 GB → 12 GB · +$-269
RTX 3060 12GB vs RTX 5080
12 GB → 16 GB · +$819
RTX 5080 vs RTX 5070 Ti
16 GB → 16 GB · +$-250
RTX 5070 Ti vs RTX 5060 Ti 16GB
16 GB → 16 GB · +$-400
RTX 5060 Ti 16GB vs RTX 4080 SUPER
16 GB → 16 GB · +$650
RTX 4080 SUPER vs RTX 4080
16 GB → 16 GB · +$0
RTX 4080 vs RTX 4070 Ti SUPER
16 GB → 16 GB · +$-270
RTX 4070 Ti SUPER vs RTX 4060 Ti 16GB
16 GB → 16 GB · +$-370
RTX 4060 Ti 16GB vs RTX 4090
16 GB → 24 GB · +$1440
RTX 4090 vs RTX 3090 Ti
24 GB → 24 GB · +$-949
RTX 3090 Ti vs RTX 3090
24 GB → 24 GB · +$-50
RTX 3090 vs L4
24 GB → 24 GB · +$1300
L4 vs RTX 5090
24 GB → 32 GB · +$199
RTX 5090 vs A100 40GB
32 GB → 40 GB · +$5601
A100 40GB vs A6000 Pro
40 GB → 48 GB · +$-3800
A6000 Pro vs RTX 6000 Ada
48 GB → 48 GB · +$2800
RTX 6000 Ada vs L40S
48 GB → 48 GB · +$1500
L40S vs H100 PCIe
48 GB → 80 GB · +$19500
H100 PCIe vs H100 SXM5
80 GB → 80 GB · +$12000
H100 SXM5 vs A100 80GB
80 GB → 80 GB · +$-29000
A100 80GB vs H200 SXM5
80 GB → 141 GB · +$34000

Discrete vs Apple unified memory

RTX 5060 vs M3 Max 64GB
8 GB discrete → 64 GB unified · MLX vs CUDA
RTX 4060 Ti 8GB vs M3 Max 64GB
8 GB discrete → 64 GB unified · MLX vs CUDA
RTX 4060 vs M3 Max 64GB
8 GB discrete → 64 GB unified · MLX vs CUDA