gpus/amd/mi300x

MI300X

Released 2023-12-06 · Street $15,000

vram

192 GB

discrete

bandwidth

5,300

GB/s

models fit

top · FP16

power

750 W

high

▸Spec sheet · top pick

Hardware spec

MI300X

AMD · CDNA 3 · gfx942

★ Sweet spot for this card

gemma 3 27b

FP16 · GGUF · 57.2 GB

bench50.6 · conf A

vram57.2 / 192 GB

speed93 tok/s

Best benchmark per GB of VRAM in your tier. FP16wastes <3% quality vs FP16, leaves headroom for 32k context.

#	model	quant	vram	tok/s	bench ↓	fit
01	gemma 3 27b	FP16	57.2 GB	93	50.6	Great
02	Qwen2.5 Coder 32B	FP16	67.7 GB	78	48.8	Great
03	Llama 4 Maverick 17B 128E	Q2_K	158 GB	34	59.3	Great
04	Gemma 2 27B	FP16	57.2 GB	93	46.2	Great
05	deepseek r1 distill llama 70b	FP16	147.5 GB	36	51.7	Great
06	Qwen3 32B	FP16	67.7 GB	78	40.0	Great
07	Gemma 2 9B	FP16	19.4 GB	273	35.0	Great
08	Gemma 3 12B	FP16	25.7 GB	206	31.3	Great
09	deepseek r1 distill qwen 32b	FP16	67.7 GB	78	33.3	Great
10	Mixtral 8x22b v0.1	Q8_0	148.6 GB	36	20.0	Great