Skip to content
localmodel.run

Text model · Ornith

OR Ornith 1.5 9B: RAM and VRAM requirements

Ornith 1.5 9B needs about 6.9 GB to run at Q4_K_M (the Q4_K_M GGUF file is ~5.38 GB to download; KV cache and overhead add the rest), or about 10.6 GB at Q8_0. The lightest hardware that runs it is Nvidia GeForce RTX 3060 Ti (8GB).

Ornith family · 9B params · released Aug 2026 · 124.2K Ollama pulls.

Shopping for hardware? See what runs Ornith 1.5 9B →

License MIT · Commercial OK ↓ 341.5K/mo ♥ 278 on HuggingFace
Q4_K_M GGUF
5.38 GB
Q8_0 GGUF
9.11 GB
Memory @ Q4 (4k)
~6.9 GB
Context
256 k

Q4_K_M and Q8_0 are GGUF download (file) sizes. Memory @ Q4 includes the KV cache and overhead, so it runs larger than the file on disk.

Will it run on your device?

Ornith 1.5 9B runs on 35 of 43 tracked devices at Q4_K_M.

33 run well 2 tight fit 8 too small
Fit check Q4_K_M
Yes, it runs fast
needs 6.9 GB usable 10.5 GB
See the full breakdown
$ollama run ornith-1.5:9b

Memory breakdown

Weights (Q4_K_M)5.38 GB
+
KV cache (4k)0.7 GB
+
Overhead0.8 GB
=
Total6.9 GB

How context length changes it

4k context ~6.9 GB 32k context ~12 GB 128k context ~29.2 GB

Longer context grows the KV cache quickly: Ornith 1.5 9B needs ~6.9 GB at 4k but ~29.2 GB at 128k, which can push it past a device that fits it at a short context.

Speed drops too: every token re-reads the KV cache, so at 128k context Ornith 1.5 9B generates at roughly ~19% of its short-context speed. How this is estimated.

Quantization sizes

GGUF quantson disk
Quantization Size on disk
Q2_K 3.8 GB est
Q3_K_M 4.4 GB est
Q4_K_M (default) 5.38 GB
Q5_K_M 6.4 GB est
Q6_K 7.4 GB est
Q8_0 9.11 GB
FP16 19.33 GB

Lower quant = smaller and faster, slightly lower quality. Q4_K_M is the common default.

Run it

Ollama
$ ollama run ornith-1.5:9b
llama.cpp
$ llama-cli -hf ornith-ai/Ornith-1.5-9B-GGUF:Q4_K_M
LM Studio
$ lms get ornith-ai/Ornith-1.5-9B-GGUF

Which devices can run Ornith 1.5 9B?

NVIDIA GPUs

Apple Silicon Macs

RAM-only laptops

iPhone & iPad

Android

AMD GPUs

Same job, different size

Pick by what fits your memory: step down to free up VRAM, or step up if you have headroom.

Next size down Granite 4.1 8B 8.8B Next size up Falcon3 10B 10B

Similar models

Head-to-head

FAQ

How much VRAM or RAM does Ornith 1.5 9B need?

At Q4_K_M, Ornith 1.5 9B needs about 6.9 GB (weights ~5.38 GB + KV cache + overhead) at a 4k context. At Q8_0 budget ~10.6 GB.

What is the Q4_K_M GGUF file size of Ornith 1.5 9B?

The Q4_K_M GGUF file is about 5.38 GB to download, and the Q8_0 GGUF is about 9.11 GB. That is the weights file on disk; to run it you also need room for the KV cache and overhead, so budget ~6.9 GB of memory at Q4_K_M.

Can Ornith 1.5 9B run on a laptop?

Ornith 1.5 9B is large; you need a 24 GB+ GPU or a 32-48 GB Mac at Q4_K_M.

Can I use Ornith 1.5 9B commercially?

Yes. Ornith 1.5 9B is licensed MIT, which permits commercial use.

Understand the numbers

Short guides to the ideas behind Ornith 1.5 9B's memory and quant figures.

DeepReinforce's Ornith 1.5 generation (new ornith-ai org handle), trained via end-to-end self-improvement, now with vision. Dense 9B on the Qwen3.5 architecture, 256K context, MIT. Sizes from the vendor GGUF repo; Ollama's 9b tag packs the Q5_K_M (6.55GB), not the Q4.

Sources

Last validated 2026-09-07. Memory figures are estimates. See methodology.