LiveBench
instruction following72.8
coding23.4
language12.6
overall36.3
| by gpu tier | Q2_K — | Q4_K_M — | Q5_K_M — | Q6_K — | Q8_0 — | FP16 — |
|---|
| 8 GB tier rtx 3050 · 4060 | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
| 12 GB tier rtx 3060 · 4070 | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
| 16 GB tier rtx 4080 · 4060 ti 16g | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
| 24 GB tier rtx 3090 · 4090 | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
| 32 GB tier rtx 5090 · m3 max | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
| 48 GB tier a6000 · m3 max 64 | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
| 80 GB tier h100 · m3 ultra 128 | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
full fit · production speed tight fit · usabledoesn't fit
Get personalized ranking
Tell us your machine — we'll tell you if this is actually your best pick, or what's better.