audio model · LFM · Windows
Can I run LFM3 Audio 2B on Nvidia GeForce RTX 5070 (12GB)?
Yes. LFM3 Audio 2B runs on Nvidia GeForce RTX 5070 (12GB) at Q8_0, audio.cpp ASR (~4.61 GB of ~11 GB usable).
Runs at Q8_0, audio.cpp ASR using ~4.61 GB of ~11 GB usable.
- Peak memory
- ~4.61 GB
- Usable on device
- ~11 GB
- Device memory
- 12 GB
- Quant
- Q8_0, audio.cpp ASR
How to run it
Use audio.cpp (experimental) at Q8_0, audio.cpp ASR. It loads as a single model and runs on a GPU.
- Type
- Speech recognition
- Parameters
- 2B
- Peak memory
- ~4.61 GB at Q8_0, audio.cpp ASR
- License
- LFM Open License v1.0
- Memory
- 12 GB vram
- Usable for weights
- ~11 GB
- Power draw
- ~250 W
- Best runtime
- Ollama (CUDA) / vLLM (Linux)
You could also run
Run LFM3 Audio 2B on other hardware
FAQ
Can Nvidia GeForce RTX 5070 (12GB) run LFM3 Audio 2B?
Yes. LFM3 Audio 2B runs on Nvidia GeForce RTX 5070 (12GB) at Q8_0, audio.cpp ASR (~4.61 GB of ~11 GB usable).
How much memory does LFM3 Audio 2B need?
Nvidia GeForce RTX 5070 (12GB) has room to spare. At Q8_0, audio.cpp ASR the realistic peak is ~4.61 GB of memory.
What do I use to run LFM3 Audio 2B locally?
LFM3 Audio 2B runs in audio.cpp (experimental). It needs a GPU.
Sources
-
en.wikipedia.org · 1 source
-
github.com · 1 source
-
lmstudio.ai · 1 source
-
nvidia.com · 1 source
-
nvidianews.nvidia.com · 1 source
-
ollama.com · 2 sources
VRAM figures are sourced peak-usage anchors at the noted quant; catalog updated 2026-11-01. See methodology.