Hardware guide · dots.llm
DO What hardware do you need to run dots.llm1?
dots.llm1 needs about 98.1 GB to run at Q4_K_M, so the lightest hardware that runs it is Apple M3 Ultra (256GB). 1 of 40 devices tested can run it.
- Needs (Q4_K_M)
- ~98.1 GB
- Devices that run it
- 1
- Too small
- 39
- Lightest that runs it
- ~192 GB
Recommended Q4_K_M
Runs at Q4_K_M using ~98.1 GB of ~192 GB usable. You have room for Q8_0 for higher quality.
What kind of hardware runs dots.llm1
Of the 1 devices that run it, here is the split by hardware class.
1 Mac
Hardware that runs dots.llm1
Ranked by usable memory, lightest first. Prices are approximate street prices for the device itself (a GPU is the card alone; a Mac is the whole machine). Tok/s is a bandwidth estimate; see methodology.
Compatible devices 1 total
Too small for dots.llm1
Apple M4 Max (128GB) AMD Ryzen AI Halo (128GB) Apple M5 Max (128GB) Apple M4 Max (64GB) Apple M4 Pro (48GB) Apple M5 Pro (48GB) Nvidia GeForce RTX 5090 (32GB) 32GB RAM Laptop (CPU/iGPU only) Nvidia GeForce RTX 4090 (24GB) Nvidia GeForce RTX 3090 (24GB) AMD Radeon RX 7900 XTX (24GB) Apple M5 (32GB) Apple M4 (24GB) Apple M4 Pro (24GB) Nvidia GeForce RTX 4060 Ti (16GB) Nvidia GeForce RTX 4080 (16GB) Apple M3 Pro (18GB) 16GB RAM Laptop (CPU/iGPU only) iPad Pro M4 (16GB, 1TB/2TB config) Samsung Galaxy S25 Ultra (16GB, 1TB config only) Samsung Galaxy S26 Ultra (16GB, 1TB config) Nvidia GeForce RTX 3060 (12GB) Nvidia GeForce RTX 4070 (12GB) Apple M2 (16GB) Apple M4 (16GB) Google Pixel 9 Pro Apple M5 (16GB) Google Pixel 10 Pro Samsung Galaxy S24 Ultra Generic Android Phone (12GB RAM) iPhone 17 Pro iPhone Air Apple M1 (8GB) 8GB RAM Laptop (CPU/iGPU only) iPhone 15 Pro iPhone 16 iPhone 16 Pro Generic Android Phone (8GB RAM) iPhone 17
See the full dots.llm1 memory breakdown, or compare it against other models.
Sources
Memory at Q4_K_M (98.1 GB = 94.4 GB weights + KV cache + overhead), validated 2026-08-03. See methodology.