what/llm/can/i/run

Compare GPUs for Local LLMs

Adjacent-tier comparisons and cross-architecture matchups. Each page shows spec diff, which models the upgrade unlocks, speed deltas on shared models, and an honest value verdict.

▸Adjacent NVIDIA tier

RTX 5060 vs RTX 4060 Ti 8GB
8 GB → 8 GB · +$60
RTX 4060 Ti 8GB vs RTX 4060
8 GB → 8 GB · +$-90
RTX 4060 vs RTX 3070 Ti
8 GB → 8 GB · +$110
RTX 3070 Ti vs RTX 3070
8 GB → 8 GB · +$-50
RTX 3070 vs RTX 3060 Ti
8 GB → 8 GB · +$-40
RTX 3060 Ti vs RTX 3060 8GB
8 GB → 8 GB · +$-60
RTX 3060 8GB vs RTX 3050 8GB
8 GB → 8 GB · +$-30
RTX 3050 8GB vs RTX 2080 SUPER
8 GB → 8 GB · +$1
RTX 2080 SUPER vs RTX 3080 10GB
8 GB → 10 GB · +$229
RTX 3080 10GB vs RTX 2080 Ti
10 GB → 11 GB · +$-150
RTX 2080 Ti vs RTX 5070
11 GB → 12 GB · +$300
RTX 5070 vs RTX 4070 Ti
12 GB → 12 GB · +$151
RTX 4070 Ti vs RTX 4070 SUPER
12 GB → 12 GB · +$-121
RTX 4070 SUPER vs RTX 4070
12 GB → 12 GB · +$-80
RTX 4070 vs RTX 3080 Ti
12 GB → 12 GB · +$100
RTX 3080 Ti vs RTX 3080 12GB
12 GB → 12 GB · +$-100
RTX 3080 12GB vs RTX 3060 12GB
12 GB → 12 GB · +$-269
RTX 3060 12GB vs RTX 5080
12 GB → 16 GB · +$819
RTX 5080 vs RTX 5070 Ti
16 GB → 16 GB · +$-250
RTX 5070 Ti vs RTX 5060 Ti 16GB
16 GB → 16 GB · +$-400
RTX 5060 Ti 16GB vs RTX 4080 SUPER
16 GB → 16 GB · +$650
RTX 4080 SUPER vs RTX 4080
16 GB → 16 GB · +$0
RTX 4080 vs RTX 4070 Ti SUPER
16 GB → 16 GB · +$-270
RTX 4070 Ti SUPER vs RTX 4060 Ti 16GB
16 GB → 16 GB · +$-370
RTX 4060 Ti 16GB vs RTX 4090
16 GB → 24 GB · +$1440
RTX 4090 vs RTX 3090 Ti
24 GB → 24 GB · +$-949
RTX 3090 Ti vs RTX 3090
24 GB → 24 GB · +$-50
RTX 3090 vs L4
24 GB → 24 GB · +$1300
L4 vs RTX 5090
24 GB → 32 GB · +$199
RTX 5090 vs A100 40GB
32 GB → 40 GB · +$5601
A100 40GB vs A6000 Pro
40 GB → 48 GB · +$-3800
A6000 Pro vs RTX 6000 Ada
48 GB → 48 GB · +$2800
RTX 6000 Ada vs L40S
48 GB → 48 GB · +$1500
L40S vs H100 PCIe
48 GB → 80 GB · +$19500
H100 PCIe vs H100 SXM5
80 GB → 80 GB · +$12000
H100 SXM5 vs A100 80GB
80 GB → 80 GB · +$-29000
A100 80GB vs H200 SXM5
80 GB → 141 GB · +$34000

▸Discrete vs Apple unified memory

RTX 5060 vs M3 Max 64GB
8 GB discrete → 64 GB unified · MLX vs CUDA
RTX 4060 Ti 8GB vs M3 Max 64GB
8 GB discrete → 64 GB unified · MLX vs CUDA
RTX 4060 vs M3 Max 64GB
8 GB discrete → 64 GB unified · MLX vs CUDA