Skip to content
localmodel.run

audio model · whisper · Linux

Can I run Whisper small on Nvidia DGX Spark (128GB)?

Compatibility verdict memory check
Yes, it runs fast on this GPU

Yes. Whisper small runs on Nvidia DGX Spark (128GB) at fp16 (whisper.cpp) (~0.85 GB of ~112 GB usable).

Needs ~0.85 GB Device usable ~112 GB

Runs at fp16 (whisper.cpp) using ~0.85 GB of ~112 GB usable.

Peak memory
~0.85 GB
Usable on device
~112 GB
Device memory
128 GB
Quant
fp16 (whisper.cpp)
Share on X Share on Reddit

How to run it

Use whisper.cpp or faster-whisper at fp16 (whisper.cpp). It is light enough to run on CPU; a GPU just makes it faster.

Model whisper
Type
Speech to text
Parameters
244M
Peak memory
~0.85 GB at fp16 (whisper.cpp)
License
MIT
Full Whisper small requirements →
Device Linux
Memory
128 GB unified
Usable for weights
~112 GB
Power draw
~140 W
Best runtime
llama.cpp (CUDA) / Ollama (CUDA)
Best models for Nvidia DGX Spark (128GB) →

You could also run

Run Whisper small on other hardware

Nvidia GeForce RTX 2060 (6GB)Apple M1 (8GB)8GB RAM Laptop (CPU/iGPU only)iPhone 15 ProiPhone 16iPhone 16 Pro

FAQ

Can Nvidia DGX Spark (128GB) run Whisper small?

Yes. Whisper small runs on Nvidia DGX Spark (128GB) at fp16 (whisper.cpp) (~0.85 GB of ~112 GB usable).

How much memory does Whisper small need?

Nvidia DGX Spark (128GB) has room to spare. At fp16 (whisper.cpp) the realistic peak is ~0.85 GB of memory.

What do I use to run Whisper small locally?

Whisper small runs in whisper.cpp or faster-whisper (among others). It runs on CPU, so no GPU is required.

Sources

VRAM figures are sourced peak-usage anchors at the noted quant; catalog updated 2026-11-01. See methodology.