Skip to content
localmodel.run

Hardware guide · Granite

What hardware do you need to run Granite 3.1 2B?

Granite 3.1 2B needs about 2.8 GB to run at Q4_K_M, so the lightest hardware that runs it is iPhone 15 Pro. 40 of 40 devices tested can run it.

Needs (Q4_K_M)
~2.8 GB
Devices that run it
40
Too small
0
Lightest that runs it
~4.5 GB
Recommended Q4_K_M
iPhone 15 Pro Yes

Runs at Q4_K_M using ~2.8 GB of ~4.5 GB usable. You have room for Q8_0 for higher quality.

What kind of hardware runs Granite 3.1 2B

Of the 40 devices that run it, here is the split by hardware class.

9 discrete GPUs 14 Macs 3 laptops 14 phones

Hardware that runs Granite 3.1 2B

Ranked by usable memory, lightest first. Prices are approximate street prices for the device itself (a GPU is the card alone; a Mac is the whole machine). Tok/s is a bandwidth estimate; see methodology.

Compatible devices 40 total

See the full Granite 3.1 2B memory breakdown, or compare it against other models.

Sources

Memory at Q4_K_M (2.8 GB = 1.55 GB weights + KV cache + overhead), validated 2026-08-03. See methodology.