audio model · LFM · Windows
Can I run LFM3 Audio 2B on Nvidia GeForce RTX 4080 (16GB)?
Yes. LFM3 Audio 2B runs on Nvidia GeForce RTX 4080 (16GB) at Q8_0, audio.cpp ASR (~4.61 GB of ~15 GB usable).
Runs at Q8_0, audio.cpp ASR using ~4.61 GB of ~15 GB usable.
- Peak memory
- ~4.61 GB
- Usable on device
- ~15 GB
- Device memory
- 16 GB
- Quant
- Q8_0, audio.cpp ASR
How to run it
Use audio.cpp (experimental) at Q8_0, audio.cpp ASR. It loads as a single model and runs on a GPU.
- Type
- Speech recognition
- Parameters
- 2B
- Peak memory
- ~4.61 GB at Q8_0, audio.cpp ASR
- License
- LFM Open License v1.0
- Memory
- 16 GB vram
- Usable for weights
- ~15 GB
- Power draw
- ~320 W
- Best runtime
- vLLM (Linux) / Ollama (CUDA)
You could also run
Run LFM3 Audio 2B on other hardware
FAQ
Can Nvidia GeForce RTX 4080 (16GB) run LFM3 Audio 2B?
Yes. LFM3 Audio 2B runs on Nvidia GeForce RTX 4080 (16GB) at Q8_0, audio.cpp ASR (~4.61 GB of ~15 GB usable).
How much memory does LFM3 Audio 2B need?
Nvidia GeForce RTX 4080 (16GB) has room to spare. At Q8_0, audio.cpp ASR the realistic peak is ~4.61 GB of memory.
What do I use to run LFM3 Audio 2B locally?
LFM3 Audio 2B runs in audio.cpp (experimental). It needs a GPU.
Sources
-
en.wikipedia.org · 1 source
-
github.com · 1 source
-
lmstudio.ai · 1 source
-
nvidia.com · 2 sources
-
ollama.com · 2 sources
-
pny.com · 1 source
-
rxelectronics.nz · 1 source
VRAM figures are sourced peak-usage anchors at the noted quant; catalog updated 2026-11-01. See methodology.