Skip to content
localmodel.run

audio model · LFM · Windows

Can I run LFM3 Audio 2B on Nvidia GeForce RTX 2060 (6GB)?

Compatibility verdict memory check
Yes, but tight fast on this GPU

Yes. LFM3 Audio 2B runs on Nvidia GeForce RTX 2060 (6GB) at Q8_0, audio.cpp ASR (~4.61 GB of ~5 GB usable).

Needs ~4.61 GB Device usable ~5 GB

Fits at Q8_0, audio.cpp ASR (~4.61 GB of ~5 GB usable) but with little headroom. Close other apps to free a little VRAM before generating.

Peak memory
~4.61 GB
Usable on device
~5 GB
Device memory
6 GB
Quant
Q8_0, audio.cpp ASR
Share on X Share on Reddit

How to run it

Use audio.cpp (experimental) at Q8_0, audio.cpp ASR. It loads as a single model and runs on a GPU.

Model LFM
Type
Speech recognition
Parameters
2B
Peak memory
~4.61 GB at Q8_0, audio.cpp ASR
License
LFM Open License v1.0
Full LFM3 Audio 2B requirements →
Device Windows
Memory
6 GB vram
Usable for weights
~5 GB
Power draw
~160 W
Best runtime
Ollama (CUDA) / llama.cpp CUDA
Best models for Nvidia GeForce RTX 2060 (6GB) →

You could also run

Run LFM3 Audio 2B on other hardware

Apple M1 (8GB)Nvidia GeForce RTX 3060 Ti (8GB)Nvidia GeForce GTX 1070 (8GB)Nvidia GeForce RTX 3060 (12GB)Nvidia GeForce RTX 4070 (12GB)Nvidia GeForce RTX 5070 (12GB)

FAQ

Can Nvidia GeForce RTX 2060 (6GB) run LFM3 Audio 2B?

Yes. LFM3 Audio 2B runs on Nvidia GeForce RTX 2060 (6GB) at Q8_0, audio.cpp ASR (~4.61 GB of ~5 GB usable).

How much memory does LFM3 Audio 2B need?

It is a tight fit on Nvidia GeForce RTX 2060 (6GB). At Q8_0, audio.cpp ASR the realistic peak is ~4.61 GB of memory.

What do I use to run LFM3 Audio 2B locally?

LFM3 Audio 2B runs in audio.cpp (experimental). It needs a GPU.

Sources

VRAM figures are sourced peak-usage anchors at the noted quant; catalog updated 2026-11-01. See methodology.