What is the minimum hardware to run Olmo 3.1 32B Instruct?

Apple M5 (32GB) is the lightest device that runs Olmo 3.1 32B Instruct, using ~20.3 GB at Q4_K_M of its ~21 GB usable. Anything with less usable memory cannot load it.

How much memory does Olmo 3.1 32B Instruct need?

At Q4_K_M it needs about 20.3 GB (weights ~18.14 GB + KV cache + overhead at 4k context). At Q8_0 budget ~34.1 GB.

Can I run Olmo 3.1 32B Instruct on a Mac?

Yes. Olmo 3.1 32B Instruct runs on Apple Silicon with enough unified memory; the ranked list below shows the lightest Mac that fits.

Can I run Olmo 3.1 32B Instruct on a phone?

No. Olmo 3.1 32B Instruct is too large for current phone memory at Q4_K_M; stick to a laptop, desktop GPU, or Mac.

Olmo 3.1 32B Instruct: what hardware do you need to run it? (2026)

What kind of hardware runs Olmo 3.1 32B Instruct

Of the 13 devices that run it, here is the split by hardware class.

5 discrete GPUs 7 Macs 1 laptop

Hardware that runs Olmo 3.1 32B Instruct

Ranked by usable memory, lightest first. Prices are approximate street prices for the device itself (a GPU is the card alone; a Mac is the whole machine). Tok/s is a bandwidth estimate; see methodology.

Compatible devices 13 total

Apple M5 (32GB) from $1,299

~21 GB usable · uses ~20.3 GB · ~7 tok/s est.

Tight
Nvidia GeForce RTX 4090 (24GB) from $1,599

~23 GB usable · uses ~20.3 GB · ~36 tok/s est.

Yes
Nvidia GeForce RTX 3090 (24GB) from $1,499

~23 GB usable · uses ~20.3 GB · ~34 tok/s est.

Yes
AMD Radeon RX 7900 XTX (24GB) from $999

~23 GB usable · uses ~20.3 GB · ~34 tok/s est.

Yes
32GB RAM Laptop (CPU/iGPU only) from $1,100

~28 GB usable · uses ~20.3 GB · ~2 tok/s est.

Yes
Nvidia GeForce RTX 5090 (32GB) from $1,999

~31 GB usable · uses ~20.3 GB · ~64 tok/s est.

Yes
Apple M4 Pro (48GB) from $2,399

~32 GB usable · uses ~20.3 GB · ~12 tok/s est.

Yes
Apple M5 Pro (48GB) from $2,199

~32 GB usable · uses ~20.3 GB · ~14 tok/s est.

Yes
Apple M4 Max (64GB) from $3,499

~48 GB usable · uses ~20.3 GB · ~24 tok/s est.

Yes
Apple M4 Max (128GB) from $3,499

~96 GB usable · uses ~20.3 GB · ~24 tok/s est.

Yes
AMD Ryzen AI Halo (128GB) from $3,999

~96 GB usable · uses ~20.3 GB · ~9 tok/s est.

Yes
Apple M5 Max (128GB) from $3,599

~96 GB usable · uses ~20.3 GB · ~27 tok/s est.

Yes
Apple M3 Ultra (256GB) from $3,999

~192 GB usable · uses ~20.3 GB · ~36 tok/s est.

Yes

OL What hardware do you need to run Olmo 3.1 32B Instruct?

What kind of hardware runs Olmo 3.1 32B Instruct

Hardware that runs Olmo 3.1 32B Instruct

Too small for Olmo 3.1 32B Instruct

Sources