Skip to content
localmodel.run

Hardware guide · SmolLM2

What hardware do you need to run SmolLM2 360M?

SmolLM2 360M needs about 1.2 GB to run at Q4_K_M, so the lightest hardware that runs it is iPhone 15 Pro. 40 of 40 devices tested can run it.

Needs (Q4_K_M)
~1.2 GB
Devices that run it
40
Too small
0
Lightest that runs it
~4.5 GB
Recommended Q4_K_M
iPhone 15 Pro Yes

Runs at Q4_K_M using ~1.2 GB of ~4.5 GB usable. You have room for FP16 for higher quality.

What kind of hardware runs SmolLM2 360M

Of the 40 devices that run it, here is the split by hardware class.

9 discrete GPUs 14 Macs 3 laptops 14 phones

Hardware that runs SmolLM2 360M

Ranked by usable memory, lightest first. Prices are approximate street prices for the device itself (a GPU is the card alone; a Mac is the whole machine). Tok/s is a bandwidth estimate; see methodology.

Compatible devices 40 total

See the full SmolLM2 360M memory breakdown, or compare it against other models.

Sources

Memory at Q4_K_M (1.2 GB = 0.271 GB weights + KV cache + overhead), validated 2026-08-03. See methodology.