Skip to content
localmodel.run

audio model · musicgen · Linux

Can I run MusicGen small on Nvidia DGX Spark (128GB)?

Compatibility verdict memory check
Yes, it runs fast on this GPU

Yes. MusicGen small runs on Nvidia DGX Spark (128GB) at fp32 (~3 GB of ~112 GB usable).

Needs ~3 GB Device usable ~112 GB

Runs at fp32 using ~3 GB of ~112 GB usable.

Peak memory
~3 GB
Usable on device
~112 GB
Device memory
128 GB
Quant
fp32
Share on X Share on Reddit

How to run it

Use AudioCraft or HF Transformers at fp32. It loads as a single model and runs on a GPU.

Model musicgen
Type
Music generation
Parameters
300M
Peak memory
~3 GB at fp32
License
CC-BY-NC-4.0
Full MusicGen small requirements →
Device Linux
Memory
128 GB unified
Usable for weights
~112 GB
Power draw
~140 W
Best runtime
llama.cpp (CUDA) / Ollama (CUDA)
Best models for Nvidia DGX Spark (128GB) →

You could also run

Run MusicGen small on other hardware

Nvidia GeForce RTX 2060 (6GB)Apple M1 (8GB)Nvidia GeForce RTX 3060 Ti (8GB)Nvidia GeForce GTX 1070 (8GB)Nvidia GeForce RTX 3060 (12GB)Nvidia GeForce RTX 4070 (12GB)

FAQ

Can Nvidia DGX Spark (128GB) run MusicGen small?

Yes. MusicGen small runs on Nvidia DGX Spark (128GB) at fp32 (~3 GB of ~112 GB usable).

How much memory does MusicGen small need?

Nvidia DGX Spark (128GB) has room to spare. At fp32 the realistic peak is ~3 GB of memory.

What do I use to run MusicGen small locally?

MusicGen small runs in AudioCraft or HF Transformers. It needs a GPU.

Sources

VRAM figures are sourced peak-usage anchors at the noted quant; catalog updated 2026-11-01. See methodology.