Skip to content
localmodel.run

Text model · Muse

MU Muse Glimmer 30B: RAM and VRAM requirements

Muse Glimmer 30B needs about 18.2 GB to run at Q4_K_M (the Q4_K_M GGUF file is ~16.12 GB to download; KV cache and overhead add the rest), or about 32.2 GB at Q8_0. The lightest hardware that runs it is Nvidia GeForce RTX 4090 (24GB).

Muse family · 30B params · released Aug 2026 · 174.8K Ollama pulls.

Shopping for hardware? See what runs Muse Glimmer 30B →

License Apache-2.0 · Commercial OK ↓ 655.1K/mo ♥ 1.9K on HuggingFace
Q4_K_M GGUF
16.12 GB
Q8_0 GGUF
30.12 GB
Memory @ Q4 (4k)
~18.2 GB
Context
128 k

Q4_K_M and Q8_0 are GGUF download (file) sizes. Memory @ Q4 includes the KV cache and overhead, so it runs larger than the file on disk.

Will it run on your device?

Muse Glimmer 30B runs on 13 of 43 tracked devices at Q4_K_M.

13 run well 0 tight fit 30 too small
Fit check Q4_K_M
No, not enough memory
needs 18.2 GB usable 10.5 GB
See the full breakdown

Memory breakdown

Weights (Q4_K_M)16.12 GB
+
KV cache (4k)1.3 GB
+
Overhead0.8 GB
=
Total18.2 GB

How context length changes it

4k context ~18.2 GB 32k context ~27.4 GB 128k context ~59 GB

Longer context grows the KV cache quickly: Muse Glimmer 30B needs ~18.2 GB at 4k but ~59 GB at 128k, which can push it past a device that fits it at a short context.

Speed drops too: every token re-reads the KV cache, so at 128k context Muse Glimmer 30B generates at roughly ~28% of its short-context speed. How this is estimated.

Quantization sizes

GGUF quantson disk
Quantization Size on disk
Q2_K 12.6 GB est
Q3_K_M 14.7 GB est
Q4_K_M (default) 16.12 GB
Q5_K_M 21.4 GB est
Q6_K 24.6 GB est
Q8_0 30.12 GB
FP16 60 GB est

Lower quant = smaller and faster, slightly lower quality. Q4_K_M is the common default.

Run it

Ollama
$ ollama run muse-glimmer:30b
llama.cpp
$ llama-cli -hf bartowski/Muse-Glimmer-30B-GGUF:Q4_K_M
LM Studio
$ lms get bartowski/Muse-Glimmer-30B-GGUF

Which devices can run Muse Glimmer 30B?

NVIDIA GPUs

Apple Silicon Macs

RAM-only laptops

iPhone & iPad

Android

AMD GPUs

Same job, different size

Pick by what fits your memory: step down to free up VRAM, or step up if you have headroom.

Next size down Granite 4.1 30B 28.9B Next size up Qwen3 30B-A3B 30.5B

Similar models

FAQ

How much VRAM or RAM does Muse Glimmer 30B need?

At Q4_K_M, Muse Glimmer 30B needs about 18.2 GB (weights ~16.12 GB + KV cache + overhead) at a 4k context. At Q8_0 budget ~32.2 GB.

What is the Q4_K_M GGUF file size of Muse Glimmer 30B?

The Q4_K_M GGUF file is about 16.12 GB to download, and the Q8_0 GGUF is about 30.12 GB. That is the weights file on disk; to run it you also need room for the KV cache and overhead, so budget ~18.2 GB of memory at Q4_K_M.

Can Muse Glimmer 30B run on a laptop?

Muse Glimmer 30B is large; you need a 24 GB+ GPU or a 32-48 GB Mac at Q4_K_M.

Can I use Muse Glimmer 30B commercially?

Yes. Muse Glimmer 30B is licensed Apache-2.0, which permits commercial use.

Understand the numbers

Short guides to the ideas behind Muse Glimmer 30B's memory and quant figures.

Meta's return to open weights under the meta-models org, built for always-on local agents: ~29B language model plus a frozen ~1.8B ViT vision encoder (image-text-to-text), Apache-2.0. Q4_K_M and Q8_0 are bartowski's main-model files; Ollama's default tag adds the vision projector (18.16GB). fp16 omitted: the bf16 splits bundle the projector.

Sources

Last validated 2026-09-07. Memory figures are estimates. See methodology.