Text model · OLMo
OL Can I run OLMo 2 32B Instruct? Pick your device.
OLMo 2 32B Instruct is a 32B model. At Q4_K_M the weights are ~18.14 GB; with KV cache and runtime overhead, budget ~20.3 GB. Select your hardware below to see the full compatibility breakdown.
NVIDIA GPUs
- Nvidia GeForce RTX 2060 (6GB) No
- Nvidia GeForce RTX 3060 Ti (8GB) No
- Nvidia GeForce GTX 1070 (8GB) No
- Nvidia GeForce RTX 3060 (12GB) No
- Nvidia GeForce RTX 4070 (12GB) No
- Nvidia GeForce RTX 5070 (12GB) No
- Nvidia GeForce RTX 4060 Ti (16GB) No
- Nvidia GeForce RTX 4080 (16GB) No
- Nvidia GeForce RTX 5080 (16GB) No
- Nvidia GeForce RTX 5070 Ti (16GB) No
- Nvidia GeForce RTX 5060 Ti (16GB) No
- Nvidia GeForce RTX 4090 (24GB) Yes
- Nvidia GeForce RTX 3090 (24GB) Yes
- Nvidia GeForce RTX 5090 (32GB) Yes
- Nvidia DGX Spark (128GB) Yes
Apple Silicon Macs
- Apple M1 (8GB) No
- Apple M2 (16GB) No
- Apple M4 (16GB) No
- Apple M5 (16GB) No
- Apple M3 Pro (18GB) No
- Apple M4 (24GB) No
- Apple M4 Pro (24GB) No
- Apple M5 (32GB) Tight
- Apple M4 Pro (48GB) Yes
- Apple M5 Pro (48GB) Yes
- Apple M4 Max (64GB) Yes
- Apple M4 Max (128GB) Yes
- Apple M5 Max (128GB) Yes
- Apple M3 Ultra (256GB) Yes
RAM-only laptops
iPhone & iPad
Android
AMD GPUs
Memory figures are estimates. See methodology.