Skip to content

text model · Qwen2.5-Coder · iOS

Can I run Qwen2.5 Coder 1.5B on iPhone 17 Pro?

Compatibility verdict VRAM threshold engine
Yes, it runs usable speed ~42 tok/s est.

Yes. Qwen2.5 Coder 1.5B runs on iPhone 17 Pro at Q4_K_M (~2 GB of ~8 GB usable).

Needs ~2 GB Device usable ~8 GB

Runs at Q4_K_M using ~2 GB of ~8 GB usable. You have room for FP16 for higher quality.

That figure is at a 4k context and moves about ±15% as context length changes. iPhone 17 Pro leaves ~6 GB of headroom, room to step up to FP16 for higher quality.

Q4_K_M needed
~2 GB
Usable on device
~8 GB
Device memory
12 GB
Best quant
Q4_K_M
Share on X Share on Reddit

Which quant fits

Quant ladder vs ~8 GB usable
Q2_K
~1.7 GB
Q3_K_M
~1.9 GB
Q4_K_M
~2 GB
Q5_K_M
~2.2 GB
Q6_K
~2.4 GB
Q8_0
~2.6 GB
FP16
~4.2 GB
The line marks iPhone 17 Pro's ~8 GB budget; rungs past it are too large.

Running cost · estimate

Power & economics est.
Power draw
~12 W
Electricity / 1M tokens
~$0.01
Pays for itself after
~2,243M tok

At ~$0.15/kWh and the estimated ~42 tok/s, a million generated tokens costs about $0.01 in electricity. Versus a hosted API at ~$0.5 per million tokens, the ~$1,099 iPhone 17 Pro pays for itself after roughly 2,243 million tokens, so local hardware is mostly a fixed cost, not a per-token one. TDP is the peak draw, so this is an upper bound. Assumptions.

How to run it

On iOS use Apple Foundation Models (Built into iOS 26, ~3B on-device model, zero download, fully private.).

Model Qwen2.5-Coder
Parameters
1.54B
Q4_K_M size
0.92 GB
Q8_0 size
1.53 GB
Context
32k
Ollama tag
qwen2.5-coder:1.5b
Full Qwen2.5 Coder 1.5B requirements →
Device iOS
Memory
12 GB unified
Usable for weights
~8 GB
Power draw
~12 W
Best runtime
llama.cpp + Metal (via PocketPal or Off Grid app)
Best models for iPhone 17 Pro →

You could also run

Run Qwen2.5 Coder 1.5B on other hardware

FAQ

Can iPhone 17 Pro run Qwen2.5 Coder 1.5B?

Yes. Qwen2.5 Coder 1.5B runs on iPhone 17 Pro at Q4_K_M (~2 GB of ~8 GB usable).

How much memory does Qwen2.5 Coder 1.5B need?

iPhone 17 Pro has room to spare. At Q4_K_M the weights are ~0.92 GB; with KV cache and runtime overhead, budget ~2 GB at a 4k context.

What is the best tool to run Qwen2.5 Coder 1.5B on iOS?

On iPhone and iPad, Apple Foundation Models (Built into iOS 26, ~3B on-device model, zero download, fully private.) is the standard choice. Phones realistically run 1B-4B class models. Anything larger thermally throttles or OOMs.

Embed this

Qwen2.5 Coder 1.5B on iPhone 17 Pro compatibility badge A live badge for your model card or README, updated as the data is.
Markdown
$ [![Qwen2.5 Coder 1.5B on iPhone 17 Pro](https://localmodel.run/badge/qwen2.5-coder-1.5b/iphone-17-pro.svg)](https://localmodel.run/can-i-run/qwen2.5-coder-1.5b/iphone-17-pro)

Sources

Weights are measured from GGUF files; KV cache and overhead are computed, so totals can vary ~15% with context and runtime. Any tok/s is a bandwidth estimate. See methodology.