# Mistral Small 3.1 24B: RAM and VRAM requirements

> Mistral Small 3.1 24B is a 24B Mistral model. At Q4_K_M it needs about **15.4 GB** to run and fits **15 of 40** tracked devices. Minimum to run: Apple M4 (24GB).

Last validated: 2026-08-03. Sources: Ollama, HuggingFace GGUF repos, vendor specs.

## Memory by quantization
| Quant | On disk | To run (4k context) |
| --- | --- | --- |
| Q4_K_M | 13.35 GB | ~15.4 GB |
| Q8_0 | 23.33 GB | ~25.3 GB |
| FP16 | 47.15 GB | ~49.2 GB |

Memory = weights + KV cache + ~0.8 GB runtime overhead, and varies ±15% with context length.

## Will it run on my device?
- **Apple M1 (8GB)** (8 GB): No, not enough memory
- **iPhone 17** (8 GB): No, not enough memory
- **iPhone 17 Pro** (12 GB): No, not enough memory
- **16GB RAM Laptop (CPU/iGPU only)** (16 GB): No, not enough memory
- **Google Pixel 10 Pro** (16 GB): No, not enough memory
- **Nvidia GeForce RTX 3090 (24GB)** (24 GB): Yes, it runs
- **Apple M4 Pro (48GB)** (48 GB): Yes, it runs (room for Q8_0)
- **Apple M3 Ultra (256GB)** (256 GB): Yes, it runs (room for FP16)

Full table of all 40 devices: https://localmodel.run/model/mistral-small-3.1-24b

## How to run
Quickest path: `ollama run mistral-small3.1:24b`. On Mac, LM Studio (ships MLX) is fastest; on Linux, Ollama for chat or vLLM to serve; on Windows, LM Studio or Ollama.

## Details
- Parameters: 24B
- Default context: 128k tokens
- License: apache-2.0 (commercial use: yes)
- Released: 2025-03
- HuggingFace: 294,322 downloads/mo, 1377 likes

## FAQ
### How much VRAM or RAM does Mistral Small 3.1 24B need?
About 15.4 GB at Q4_K_M (weights 13.35 GB + KV cache + overhead) at a 4k context. Budget ~25.3 GB for Q8_0.
### Can Mistral Small 3.1 24B run on a laptop?
Mistral Small 3.1 24B is large; you need a high-memory Mac or a 24 GB+ GPU at Q4_K_M.
### Can I use Mistral Small 3.1 24B commercially?
Yes, apache-2.0 permits commercial use.

Sources: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503, https://huggingface.co/bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF, https://ollama.com/library/mistral-small3.1/tags
More: https://localmodel.run/model/mistral-small-3.1-24b