What is the minimum hardware to run Granite 4.0 H Small?

Apple M5 (32GB) is the lightest device that runs Granite 4.0 H Small, using ~20.4 GB at Q4_K_M of its ~21 GB usable. Anything with less usable memory cannot load it.

How much memory does Granite 4.0 H Small need?

At Q4_K_M it needs about 20.4 GB (weights ~18.23 GB + KV cache + overhead at 4k context). At Q8_0 budget ~34.1 GB.

Can I run Granite 4.0 H Small on a Mac?

Yes. Granite 4.0 H Small runs on Apple Silicon with enough unified memory; the ranked list below shows the lightest Mac that fits.

Can I run Granite 4.0 H Small on a phone?

No. Granite 4.0 H Small is too large for current phone memory at Q4_K_M; stick to a laptop, desktop GPU, or Mac.

Hardware guide · Granite

What hardware do you need to run Granite 4.0 H Small?

Granite 4.0 H Small needs about 20.4 GB to run at Q4_K_M, so the lightest hardware that runs it is Apple M5 (32GB). 13 of 40 devices tested can run it.

Needs (Q4_K_M): ~20.4 GB
Devices that run it: 13
Too small: 27
Lightest that runs it: ~21 GB

Recommended Q4_K_M

Nvidia GeForce RTX 4090 (24GB) Yes

Runs at Q4_K_M using ~20.4 GB of ~23 GB usable.

What kind of hardware runs Granite 4.0 H Small

Of the 13 devices that run it, here is the split by hardware class.

5 discrete GPUs 7 Macs 1 laptop

Hardware that runs Granite 4.0 H Small

Ranked by usable memory, lightest first. Prices are approximate street prices for the device itself (a GPU is the card alone; a Mac is the whole machine). Tok/s is a bandwidth estimate; see methodology.

Compatible devices 13 total

See the full Granite 4.0 H Small memory breakdown, or compare it against other models.

Sources

Memory at Q4_K_M (20.4 GB = 18.23 GB weights + KV cache + overhead), validated 2026-08-03. See methodology.

What hardware do you need to run Granite 4.0 H Small?

What kind of hardware runs Granite 4.0 H Small

Hardware that runs Granite 4.0 H Small

Too small for Granite 4.0 H Small

Sources