Skip to content

text model · LFM · Android

Can I run LFM2.5 1.2B Thinking on Samsung Galaxy S24 Ultra?

Compatibility verdict VRAM threshold engine
Yes, it runs usable speed ~56 tok/s est.

Yes. LFM2.5 1.2B Thinking runs on Samsung Galaxy S24 Ultra at Q4_K_M (~1.8 GB of ~8.5 GB usable).

Needs ~1.8 GB Device usable ~8.5 GB

Runs at Q4_K_M using ~1.8 GB of ~8.5 GB usable. You have room for FP16 for higher quality.

That figure is at a 4k context and moves about ±15% as context length changes. Samsung Galaxy S24 Ultra leaves ~6.7 GB of headroom, room to step up to FP16 for higher quality.

Q4_K_M needed
~1.8 GB
Usable on device
~8.5 GB
Device memory
12 GB
Best quant
Q4_K_M
Share on X Share on Reddit

Which quant fits

Quant ladder vs ~8.5 GB usable
Q2_K
~1.6 GB
Q3_K_M
~1.7 GB
Q4_K_M
~1.8 GB
Q5_K_M
~1.9 GB
Q6_K
~2.1 GB
Q8_0
~2.3 GB
FP16
~3.3 GB
The line marks Samsung Galaxy S24 Ultra's ~8.5 GB budget; rungs past it are too large.

Running cost · estimate

Power & economics est.
Power draw
~8 W
Electricity / 1M tokens
~$0.01
Pays for itself after
~2,651M tok

At ~$0.15/kWh and the estimated ~56 tok/s, a million generated tokens costs about $0.01 in electricity. Versus a hosted API at ~$0.5 per million tokens, the ~$1,299 Samsung Galaxy S24 Ultra pays for itself after roughly 2,651 million tokens, so local hardware is mostly a fixed cost, not a per-token one. TDP is the peak draw, so this is an upper bound. Assumptions.

How to run it

On Android use PocketPal AI (Polished app, download GGUF and run offline.).

Model LFM
Parameters
1.17B
Q4_K_M size
0.68 GB
Q8_0 size
1.16 GB
Context
128k
Ollama tag
lfm2.5-thinking:1.2b
Full LFM2.5 1.2B Thinking requirements →
Device Android
Memory
12 GB ram
Usable for weights
~8.5 GB
Power draw
~8 W
Best runtime
llama.cpp (PocketPal) or MLC-LLM (Adreno GPU path)
Best models for Samsung Galaxy S24 Ultra →

You could also run

Run LFM2.5 1.2B Thinking on other hardware

FAQ

Can Samsung Galaxy S24 Ultra run LFM2.5 1.2B Thinking?

Yes. LFM2.5 1.2B Thinking runs on Samsung Galaxy S24 Ultra at Q4_K_M (~1.8 GB of ~8.5 GB usable).

How much memory does LFM2.5 1.2B Thinking need?

Samsung Galaxy S24 Ultra has room to spare. At Q4_K_M the weights are ~0.68 GB; with KV cache and runtime overhead, budget ~1.8 GB at a 4k context.

What is the best tool to run LFM2.5 1.2B Thinking on Android?

On Android, PocketPal AI (Polished app, download GGUF and run offline.) is the go-to option. NPU acceleration is limited and chip-specific; most apps run on CPU. Expect 1B-4B class.

Embed this

LFM2.5 1.2B Thinking on Samsung Galaxy S24 Ultra compatibility badge A live badge for your model card or README, updated as the data is.
Markdown
$ [![LFM2.5 1.2B Thinking on Samsung Galaxy S24 Ultra](https://localmodel.run/badge/lfm2.5-1.2b-thinking/samsung-s24-ultra.svg)](https://localmodel.run/can-i-run/lfm2.5-1.2b-thinking/samsung-s24-ultra)

Sources

Weights are measured from GGUF files; KV cache and overhead are computed, so totals can vary ~15% with context and runtime. Any tok/s is a bandwidth estimate. See methodology.