Head-to-head · Granite
Granite 3.1 2B vs Granite 4.1 30B
Granite 3.1 2B needs ~2.8 GB at Q4_K_M; Granite 4.1 30B needs ~19.1 GB. That ~16.3 GB gap decides which hardware runs each; they differ on 9 of the 14 devices below.
Which devices run each
A representative spread across the memory range. Tap a verdict for the full breakdown.
Size at each quantization
* derived from bits-per-weight; unstarred sizes are measured GGUF files.
Bottom line
The larger Granite 4.1 30B needs ~19.1 GB; Granite 3.1 2B runs on lighter hardware at ~2.8 GB with more headroom and faster responses. Check each against your exact device: what runs Granite 3.1 2B · what runs Granite 4.1 30B.
More Granite comparisons
FAQ
What is the difference in memory between Granite 3.1 2B and Granite 4.1 30B?
At Q4_K_M, Granite 3.1 2B needs about 2.8 GB and Granite 4.1 30B needs about 19.1 GB, a difference of ~16.3 GB.
Should I run Granite 3.1 2B or Granite 4.1 30B?
Run Granite 4.1 30B if your hardware has the ~19.1 GB it needs and you want maximum quality; run Granite 3.1 2B (~2.8 GB) for lighter hardware, faster responses, and more memory headroom.
Full breakdowns: Granite 3.1 2B · Granite 4.1 30B · all models × devices.
Sources
Memory figures are estimates at Q4_K_M, validated 2026-08-03. See methodology.