What is the minimum hardware to run Mistral Small 3.1 24B?

Apple M4 (24GB) is the lightest device that runs Mistral Small 3.1 24B, using ~15.4 GB at Q4_K_M of its ~16 GB usable. Anything with less usable memory cannot load it.

How much memory does Mistral Small 3.1 24B need?

At Q4_K_M it needs about 15.4 GB (weights ~13.35 GB + KV cache + overhead at 4k context). At Q8_0 budget ~25.3 GB.

Can I run Mistral Small 3.1 24B on a Mac?

Yes. Mistral Small 3.1 24B runs on Apple Silicon with enough unified memory; the ranked list below shows the lightest Mac that fits.

Can I run Mistral Small 3.1 24B on a phone?

No. Mistral Small 3.1 24B is too large for current phone memory at Q4_K_M; stick to a laptop, desktop GPU, or Mac.

Mistral Small 3.1 24B: what hardware do you need to run it? (2026)

What kind of hardware runs Mistral Small 3.1 24B

Of the 15 devices that run it, here is the split by hardware class.

5 discrete GPUs 9 Macs 1 laptop

Hardware that runs Mistral Small 3.1 24B

Ranked by usable memory, lightest first. Prices are approximate street prices for the device itself (a GPU is the card alone; a Mac is the whole machine). Tok/s is a bandwidth estimate; see methodology.

Compatible devices 15 total

Apple M4 (24GB) from $1,299

~16 GB usable · uses ~15.4 GB · ~7 tok/s est.

Tight
Apple M4 Pro (24GB) from $1,999

~16 GB usable · uses ~15.4 GB · ~16 tok/s est.

Tight
Apple M5 (32GB) from $1,299

~21 GB usable · uses ~15.4 GB · ~9 tok/s est.

Yes
Nvidia GeForce RTX 4090 (24GB) from $1,599

~23 GB usable · uses ~15.4 GB · ~49 tok/s est.

Yes
Nvidia GeForce RTX 3090 (24GB) from $1,499

~23 GB usable · uses ~15.4 GB · ~46 tok/s est.

Yes
AMD Radeon RX 7900 XTX (24GB) from $999

~23 GB usable · uses ~15.4 GB · ~47 tok/s est.

Yes
32GB RAM Laptop (CPU/iGPU only) from $1,100

~28 GB usable · uses ~15.4 GB · ~3 tok/s est.

Yes
Nvidia GeForce RTX 5090 (32GB) from $1,999

~31 GB usable · uses ~15.4 GB · ~87 tok/s est.

Yes
Apple M4 Pro (48GB) from $2,399

~32 GB usable · uses ~15.4 GB · ~16 tok/s est.

Yes
Apple M5 Pro (48GB) from $2,199

~32 GB usable · uses ~15.4 GB · ~18 tok/s est.

Yes
Apple M4 Max (64GB) from $3,499

~48 GB usable · uses ~15.4 GB · ~33 tok/s est.

Yes
Apple M4 Max (128GB) from $3,499

~96 GB usable · uses ~15.4 GB · ~33 tok/s est.

Yes
AMD Ryzen AI Halo (128GB) from $3,999

~96 GB usable · uses ~15.4 GB · ~12 tok/s est.

Yes
Apple M5 Max (128GB) from $3,599

~96 GB usable · uses ~15.4 GB · ~37 tok/s est.

Yes
Apple M3 Ultra (256GB) from $3,999

~192 GB usable · uses ~15.4 GB · ~49 tok/s est.

Yes

What hardware do you need to run Mistral Small 3.1 24B?

What kind of hardware runs Mistral Small 3.1 24B

Hardware that runs Mistral Small 3.1 24B

Too small for Mistral Small 3.1 24B

Sources