Skip to content
localmodel.run

Hardware guide · Granite

What hardware do you need to run Granite 4.1 8B?

Granite 4.1 8B needs about 6.8 GB to run at Q4_K_M, so the lightest hardware that runs it is iPhone 17 Pro. 33 of 40 devices tested can run it.

Needs (Q4_K_M)
~6.8 GB
Devices that run it
33
Too small
7
Lightest that runs it
~8 GB
Recommended Q4_K_M
Apple M2 (16GB) Yes

Runs at Q4_K_M using ~6.8 GB of ~10.5 GB usable.

What kind of hardware runs Granite 4.1 8B

Of the 33 devices that run it, here is the split by hardware class.

9 discrete GPUs 13 Macs 2 laptops 9 phones

Hardware that runs Granite 4.1 8B

Ranked by usable memory, lightest first. Prices are approximate street prices for the device itself (a GPU is the card alone; a Mac is the whole machine). Tok/s is a bandwidth estimate; see methodology.

Compatible devices 33 total

Too small for Granite 4.1 8B

Apple M1 (8GB) 8GB RAM Laptop (CPU/iGPU only) iPhone 15 Pro iPhone 16 iPhone 16 Pro Generic Android Phone (8GB RAM) iPhone 17

See the full Granite 4.1 8B memory breakdown, or compare it against other models.

Sources

Memory at Q4_K_M (6.8 GB = 5.3 GB weights + KV cache + overhead), validated 2026-08-03. See methodology.