Skip to content
localmodel.run

audio model · musicgen · Windows

Can I run MusicGen small on AMD Radeon RX 9070 XT (16GB)?

Compatibility verdict memory check
Yes, it runs fast on this GPU

Yes. MusicGen small runs on AMD Radeon RX 9070 XT (16GB) at fp32 (~3 GB of ~15 GB usable).

Needs ~3 GB Device usable ~15 GB

Runs at fp32 using ~3 GB of ~15 GB usable.

Peak memory
~3 GB
Usable on device
~15 GB
Device memory
16 GB
Quant
fp32
Share on X Share on Reddit

How to run it

Use AudioCraft or HF Transformers at fp32. It loads as a single model and runs on a GPU.

Model musicgen
Type
Music generation
Parameters
300M
Peak memory
~3 GB at fp32
License
CC-BY-NC-4.0
Full MusicGen small requirements →
Device Windows
Memory
16 GB vram
Usable for weights
~15 GB
Power draw
~304 W
Best runtime
llama.cpp (Vulkan/ROCm) / Ollama (ROCm)
Best models for AMD Radeon RX 9070 XT (16GB) →

You could also run

Run MusicGen small on other hardware

Nvidia GeForce RTX 2060 (6GB)Apple M1 (8GB)Nvidia GeForce RTX 3060 Ti (8GB)Nvidia GeForce GTX 1070 (8GB)Nvidia GeForce RTX 3060 (12GB)Nvidia GeForce RTX 4070 (12GB)

FAQ

Can AMD Radeon RX 9070 XT (16GB) run MusicGen small?

Yes. MusicGen small runs on AMD Radeon RX 9070 XT (16GB) at fp32 (~3 GB of ~15 GB usable).

How much memory does MusicGen small need?

AMD Radeon RX 9070 XT (16GB) has room to spare. At fp32 the realistic peak is ~3 GB of memory.

What do I use to run MusicGen small locally?

MusicGen small runs in AudioCraft or HF Transformers. It needs a GPU.

Sources

VRAM figures are sourced peak-usage anchors at the noted quant; catalog updated 2026-11-01. See methodology.