Hardware guide · gpt-oss
What hardware do you need to run gpt-oss 120B?
gpt-oss 120B needs about 62.4 GB to run at Q4_K_M, so the lightest hardware that runs it is Apple M4 Max (128GB). 4 of 40 devices tested can run it.
- Needs (Q4_K_M)
- ~62.4 GB
- Devices that run it
- 4
- Too small
- 36
- Lightest that runs it
- ~96 GB
Recommended Q4_K_M
Runs at Q4_K_M using ~62.4 GB of ~96 GB usable. You have room for Q8_0 for higher quality.
What kind of hardware runs gpt-oss 120B
Of the 4 devices that run it, here is the split by hardware class.
1 discrete GPU 3 Macs
Hardware that runs gpt-oss 120B
Ranked by usable memory, lightest first. Prices are approximate street prices for the device itself (a GPU is the card alone; a Mac is the whole machine). Tok/s is a bandwidth estimate; see methodology.
Compatible devices 4 total
Too small for gpt-oss 120B
Apple M4 Max (64GB) Apple M4 Pro (48GB) Apple M5 Pro (48GB) Nvidia GeForce RTX 5090 (32GB) 32GB RAM Laptop (CPU/iGPU only) Nvidia GeForce RTX 4090 (24GB) Nvidia GeForce RTX 3090 (24GB) AMD Radeon RX 7900 XTX (24GB) Apple M5 (32GB) Apple M4 (24GB) Apple M4 Pro (24GB) Nvidia GeForce RTX 4060 Ti (16GB) Nvidia GeForce RTX 4080 (16GB) Apple M3 Pro (18GB) 16GB RAM Laptop (CPU/iGPU only) iPad Pro M4 (16GB, 1TB/2TB config) Samsung Galaxy S25 Ultra (16GB, 1TB config only) Samsung Galaxy S26 Ultra (16GB, 1TB config) Nvidia GeForce RTX 3060 (12GB) Nvidia GeForce RTX 4070 (12GB) Apple M2 (16GB) Apple M4 (16GB) Google Pixel 9 Pro Apple M5 (16GB) Google Pixel 10 Pro Samsung Galaxy S24 Ultra Generic Android Phone (12GB RAM) iPhone 17 Pro iPhone Air Apple M1 (8GB) 8GB RAM Laptop (CPU/iGPU only) iPhone 15 Pro iPhone 16 iPhone 16 Pro Generic Android Phone (8GB RAM) iPhone 17
See the full gpt-oss 120B memory breakdown, or compare it against other models.
Sources
Memory at Q4_K_M (62.4 GB = 59.03 GB weights + KV cache + overhead), validated 2026-08-03. See methodology.