Skip to content

Head-to-head · Mistral

Mistral Small 3 24B vs Devstral 2 123B

Mistral Small 3 24B needs ~16.3 GB at Q4_K_M; Devstral 2 123B needs ~73.3 GB. That ~57 GB gap decides which hardware runs each; they differ on 2 of the 11 devices below.

Spec Mistral Small 3 24B Devstral 2 123B
Parameters24B123B
Memory at Q4_K_M~16.3 GB~73.3 GB
Context window128k256k
LMArenaElo 1357not ranked
LicenseApache-2.0Modified MIT

Which devices run each

A representative spread across the memory range. Tap a verdict for the full breakdown.

Size at each quantization

Quant Mistral Small 3 24B Devstral 2 123B
Q2_K 10.1 GB* 51.5 GB*
Q3_K_M 11.7 GB* 60.1 GB*
Q4_K_M 14.33 GB 69.75 GB
Q5_K_M 17.1 GB* 87.6 GB*
Q6_K 19.7 GB* 100.9 GB*
Q8_0 25.05 GB 123.73 GB
FP16 48 GB* 250.06 GB

* derived from bits-per-weight; unstarred sizes are measured GGUF files.

Bottom line

The larger Devstral 2 123B needs ~73.3 GB; Mistral Small 3 24B runs on lighter hardware at ~16.3 GB with more headroom and faster responses. Check each against your exact device: what runs Mistral Small 3 24B · what runs Devstral 2 123B.

More Mistral comparisons

FAQ

What is the difference in memory between Mistral Small 3 24B and Devstral 2 123B?

At Q4_K_M, Mistral Small 3 24B needs about 16.3 GB and Devstral 2 123B needs about 73.3 GB, a difference of ~57 GB.

Should I run Mistral Small 3 24B or Devstral 2 123B?

Run Devstral 2 123B if your hardware has the ~73.3 GB it needs and you want maximum quality; run Mistral Small 3 24B (~16.3 GB) for lighter hardware, faster responses, and more memory headroom.

Full breakdowns: Mistral Small 3 24B · Devstral 2 123B · all models × devices.

Sources

Memory figures are estimates at Q4_K_M, validated 2026-09-07. See methodology.