Skip to content

Head-to-head · Sarvam

Sarvam-M 24B vs Sarvam-30B

Sarvam-M 24B needs ~16.3 GB at Q4_K_M; Sarvam-30B needs ~21.7 GB. That ~5.4 GB gap decides which hardware runs each; they differ on 0 of the 14 devices below.

Spec Sarvam-M 24B Sarvam-30B
Parameters24B30B MoE
Memory at Q4_K_M~16.3 GB~21.7 GB
Context window32k64k
LMArenanot rankednot ranked
LicenseApache-2.0Apache-2.0

Which devices run each

A representative spread across the memory range. Tap a verdict for the full breakdown.

Size at each quantization

Quant Sarvam-M 24B Sarvam-30B
Q2_K 10.1 GB* 12.6 GB*
Q3_K_M 11.7 GB* 14.7 GB*
Q4_K_M 14.3 GB 19.6 GB
Q5_K_M 17.1 GB* 21.4 GB*
Q6_K 19.7 GB* 24.6 GB*
Q8_0 25.1 GB 31.9 GB*
FP16 47.2 GB 60 GB*

* derived from bits-per-weight; unstarred sizes are measured GGUF files.

Bottom line

The larger Sarvam-30B needs ~21.7 GB; Sarvam-M 24B runs on lighter hardware at ~16.3 GB with more headroom and faster responses. Check each against your exact device: what runs Sarvam-M 24B · what runs Sarvam-30B.

More Sarvam comparisons

FAQ

What is the difference in memory between Sarvam-M 24B and Sarvam-30B?

At Q4_K_M, Sarvam-M 24B needs about 16.3 GB and Sarvam-30B needs about 21.7 GB, a difference of ~5.4 GB.

Should I run Sarvam-M 24B or Sarvam-30B?

Run Sarvam-30B if your hardware has the ~21.7 GB it needs and you want maximum quality; run Sarvam-M 24B (~16.3 GB) for lighter hardware, faster responses, and more memory headroom.

Full breakdowns: Sarvam-M 24B · Sarvam-30B · all models × devices.

Sources

Memory figures are estimates at Q4_K_M, validated 2026-08-03. See methodology.