Skip to content

text model · Qwen2.5-Coder · iOS

Can I run Qwen2.5 Coder 3B on iPhone 15 Pro?

Compatibility verdict VRAM threshold engine
Yes, it runs usable speed ~14 tok/s est.

Yes. Qwen2.5 Coder 3B runs on iPhone 15 Pro at Q4_K_M (~3 GB of ~4.5 GB usable).

Needs ~3 GB Device usable ~4.5 GB

Runs at Q4_K_M using ~3 GB of ~4.5 GB usable. You have room for Q8_0 for higher quality.

That figure is at a 4k context and moves about ±15% as context length changes. iPhone 15 Pro leaves ~1.5 GB of headroom, room to step up to Q8_0 for higher quality.

Q4_K_M needed
~3 GB
Usable on device
~4.5 GB
Device memory
8 GB
Best quant
Q4_K_M
Share on X Share on Reddit

Which quant fits

Quant ladder vs ~4.5 GB usable
Q2_K
~2.5 GB
Q3_K_M
~2.7 GB
Q4_K_M
~3 GB
Q5_K_M
~3.4 GB
Q6_K
~3.7 GB
Q8_0
~4.3 GB
FP16
~7.4 GB
The line marks iPhone 15 Pro's ~4.5 GB budget; rungs past it are too large.

Running cost · estimate

Power & economics est.
Power draw
~14 W
Electricity / 1M tokens
~$0.04
Pays for itself after
~2,172M tok

At ~$0.15/kWh and the estimated ~14 tok/s, a million generated tokens costs about $0.04 in electricity. Versus a hosted API at ~$0.5 per million tokens, the ~$999 iPhone 15 Pro pays for itself after roughly 2,172 million tokens, so local hardware is mostly a fixed cost, not a per-token one. TDP is the peak draw, so this is an upper bound. Assumptions.

How to run it

On iOS use Apple Foundation Models (Built into iOS 26, ~3B on-device model, zero download, fully private.).

Model Qwen2.5-Coder
Parameters
3.09B
Q4_K_M size
1.8 GB
Q8_0 size
3.06 GB
Context
32k
Ollama tag
qwen2.5-coder:3b
Full Qwen2.5 Coder 3B requirements →
Device iOS
Memory
8 GB unified
Usable for weights
~4.5 GB
Power draw
~14 W
Best runtime
llama.cpp + Metal (via PocketPal or Off Grid app)
Best models for iPhone 15 Pro →

You could also run

Run Qwen2.5 Coder 3B on other hardware

FAQ

Can iPhone 15 Pro run Qwen2.5 Coder 3B?

Yes. Qwen2.5 Coder 3B runs on iPhone 15 Pro at Q4_K_M (~3 GB of ~4.5 GB usable).

How much memory does Qwen2.5 Coder 3B need?

iPhone 15 Pro has room to spare. At Q4_K_M the weights are ~1.8 GB; with KV cache and runtime overhead, budget ~3 GB at a 4k context.

What is the best tool to run Qwen2.5 Coder 3B on iOS?

On iPhone and iPad, Apple Foundation Models (Built into iOS 26, ~3B on-device model, zero download, fully private.) is the standard choice. Phones realistically run 1B-4B class models. Anything larger thermally throttles or OOMs.

Embed this

Qwen2.5 Coder 3B on iPhone 15 Pro compatibility badge A live badge for your model card or README, updated as the data is.
Markdown
$ [![Qwen2.5 Coder 3B on iPhone 15 Pro](https://localmodel.run/badge/qwen2.5-coder-3b/iphone-15-pro.svg)](https://localmodel.run/can-i-run/qwen2.5-coder-3b/iphone-15-pro)

Sources

Weights are measured from GGUF files; KV cache and overhead are computed, so totals can vary ~15% with context and runtime. Any tok/s is a bandwidth estimate. See methodology.