# dots.llm1: RAM and VRAM requirements

> dots.llm1 is a 142B dots.llm model (Mixture-of-Experts, 14B active per token). At Q4_K_M it needs about **98.1 GB** to run and fits **1 of 40** tracked devices. Minimum to run: Apple M3 Ultra (256GB).

Last validated: 2026-08-03. Sources: Ollama, HuggingFace GGUF repos, vendor specs.

## Memory by quantization
| Quant | On disk | To run (4k context) |
| --- | --- | --- |
| Q4_K_M | 94.4 GB | ~98.1 GB |
| Q8_0 | 151.9 GB | ~155.6 GB |
| FP16 | 286 GB | ~289.7 GB |

Memory = weights + KV cache + ~0.8 GB runtime overhead, and varies ±15% with context length.

## Will it run on my device?
- **Apple M1 (8GB)** (8 GB): No, not enough memory
- **iPhone 17** (8 GB): No, not enough memory
- **iPhone 17 Pro** (12 GB): No, not enough memory
- **16GB RAM Laptop (CPU/iGPU only)** (16 GB): No, not enough memory
- **Google Pixel 10 Pro** (16 GB): No, not enough memory
- **Nvidia GeForce RTX 3090 (24GB)** (24 GB): No, not enough memory
- **Apple M4 Pro (48GB)** (48 GB): No, not enough memory
- **Apple M3 Ultra (256GB)** (256 GB): Yes, it runs (room for Q8_0)

Full table of all 40 devices: https://localmodel.run/model/dots-llm1

## How to run
Use LM Studio (Mac/Windows) or Ollama / vLLM (Linux).

## Details
- Parameters: 142B (MoE, 14B active per token)
- Default context: 32k tokens
- License: MIT (commercial use: yes)
- Released: 2025-06
- HuggingFace: 2,290 downloads/mo, 179 likes

## FAQ
### How much VRAM or RAM does dots.llm1 need?
About 98.1 GB at Q4_K_M (weights 94.4 GB + KV cache + overhead) at a 4k context. Budget ~155.6 GB for Q8_0.
### Can dots.llm1 run on a laptop?
dots.llm1 is large; you need a high-memory Mac or a 24 GB+ GPU at Q4_K_M.
### Can I use dots.llm1 commercially?
Yes, MIT permits commercial use.

Sources: https://huggingface.co/rednote-hilab/dots.llm1.inst, https://huggingface.co/mradermacher/dots.llm1.inst-GGUF/tree/main, https://huggingface.co/unsloth/dots.llm1.inst-GGUF
More: https://localmodel.run/model/dots-llm1