# Nemotron 3.5 Bolt E4B: RAM and VRAM requirements

> Nemotron 3.5 Bolt E4B is a 8B Nemotron model. At Q4_K_M it needs about **8.9 GB** to run and fits **35 of 49** tracked devices. Minimum to run: Nvidia GeForce RTX 3060 (12GB).

Catalog updated: 2026-11-01. Sources: Ollama, HuggingFace GGUF repos, vendor specs.

## Memory by quantization
| Quant | On disk | To run (4k context) |
| --- | --- | --- |
| Q4_K_M | 7.37 GB | ~8.9 GB |
| Q8_0 | 9.09 GB | ~10.6 GB |
| FP16 | 15.63 GB | ~17.1 GB |

Memory = weights + KV cache + ~0.8 GB runtime overhead, and varies ±15% with context length.

## Will it run on my device?
- **Nvidia GeForce RTX 2060 (6GB)** (6 GB): No, not enough memory
- **iPhone 17** (8 GB): No, not enough memory
- **iPhone 17 Pro** (12 GB): No, not enough memory
- **16GB RAM Laptop (CPU/iGPU only)** (16 GB): Yes, it runs (room for Q8_0)
- **Samsung Galaxy S26 Ultra (16GB, 1TB config)** (16 GB): Yes, it runs (room for Q8_0)
- **Apple M4 Pro (24GB)** (24 GB): Yes, it runs (room for Q8_0)
- **Apple M4 Pro (48GB)** (48 GB): Yes, it runs (room for FP16)
- **Apple M3 Ultra (256GB)** (256 GB): Yes, it runs (room for FP16)

Full table of all 49 devices: https://localmodel.run/model/nemotron-3.5-bolt-e4b

## How to run
Quickest path: `ollama run nemotron-3.5-bolt:e4b-q4_K_M`. On Mac, LM Studio (ships MLX) is fastest; on Linux, Ollama for chat or vLLM to serve; on Windows, LM Studio or Ollama.

## Details
- Parameters: 8B
- Default context: 64k tokens
- License: OpenMDW-1.1 (commercial use: yes)
- Released: 2026-10
- HuggingFace: 9,895 downloads/mo, 60 likes

## FAQ
### How much VRAM or RAM does Nemotron 3.5 Bolt E4B need?
About 8.9 GB at Q4_K_M (weights 7.37 GB + KV cache + overhead) at a 4k context. Budget ~10.6 GB for Q8_0.
### Can Nemotron 3.5 Bolt E4B run on a laptop?
Yes. Nemotron 3.5 Bolt E4B fits on a 16 GB laptop or Mac at Q4_K_M, and runs on Apple Silicon or a 12 GB+ GPU comfortably.
### Can I use Nemotron 3.5 Bolt E4B commercially?
Yes, OpenMDW-1.1 permits commercial use.

Sources: https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB, https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16, https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16/blob/main/config.json, https://ollama.com/library/nemotron-3.5-bolt:e4b-q4_K_M, https://registry.ollama.ai/v2/library/nemotron-3.5-bolt/manifests/e4b-q4_K_M, https://registry.ollama.ai/v2/library/nemotron-3.5-bolt/manifests/e4b-q8_0, https://registry.ollama.ai/v2/library/nemotron-3.5-bolt/manifests/e4b-bf16
More: https://localmodel.run/model/nemotron-3.5-bolt-e4b