Skip to content
localmodel.run

Hardware guide · SmolLM2

What hardware do you need to run SmolLM2 135M?

SmolLM2 135M needs about 1 GB to run at Q4_K_M, so the lightest hardware that runs it is iPhone 15 Pro. 43 of 43 devices tested can run it.

Needs (Q4_K_M)
~1 GB
Devices that run it
43
Too small
0
Lightest that runs it
~4.5 GB
Recommended Q4_K_M
iPhone 15 Pro Yes

Runs at Q4_K_M using ~1 GB of ~4.5 GB usable. You have room for FP16 for higher quality.

What kind of hardware runs SmolLM2 135M

Of the 43 devices that run it, here is the split by hardware class.

12 discrete GPUs 14 Macs 3 laptops 14 phones

Hardware that runs SmolLM2 135M

Ranked by usable memory, lightest first. Prices are approximate street prices for the device itself (a GPU is the card alone; a Mac is the whole machine). Tok/s is a bandwidth estimate; see methodology.

Compatible devices 43 total

See the full SmolLM2 135M memory breakdown, or compare it against other models.

Sources

Memory at Q4_K_M (1 GB = 0.105 GB weights + KV cache + overhead), validated 2026-09-14. See methodology.