Hardware spec
L4
NVIDIA · Ada Lovelace · sm_89
- vram
- 24 GB
- bandwidth
- 300 GB/s
- tdp
- 72 W
- released
- 2023-03-21
- msrp
- $2,500
- street
- ~$2,200
★ Sweet spot for this card
Q6_K · GGUF · 21.8 GB
bench50.6 · conf A
vram21.8 / 24 GB
speed14 tok/s
Best benchmark per GB of VRAM in your tier. Q6_Kwastes <3% quality vs FP16, leaves headroom for 32k context.
Full model inspect →Showing 10 of 13 models that fit ·
see full ranked list →★ Best value
32 GB · ~$2,399 · +$199 over L4
Unlocks +3 models not in current rank
See RTX 5090 →Bigger tier
48 GB · ~$4,200 · +$2,000 over L4
Unlocks +4 models not in current rank
See A6000 Pro →Premium tier
48 GB · ~$7,000 · +$4,800 over L4
Unlocks +4 models not in current rank
See RTX 6000 Ada →Not running a L4?
Tell us what you actually have — we'll re-rank everything for your machine.