Skip to content

Head-to-head · Nemotron

Nemotron Nano 9B v2 vs Nemotron 3.5 Super VL 120B-A12B

Nemotron Nano 9B v2 needs ~7.6 GB at Q4_K_M; Nemotron 3.5 Super VL 120B-A12B needs ~87.4 GB. That ~79.8 GB gap decides which hardware runs each; they differ on 8 of the 13 devices below.

Spec Nemotron Nano 9B v2 Nemotron 3.5 Super VL 120B-A12B
Parameters9B120B MoE
Memory at Q4_K_M~7.6 GB~87.4 GB
Context window128k1024k
LMArenanot rankednot ranked
Licensenvidia-open-model-licenseOpenMDW-1.1

Which devices run each

A representative spread across the memory range. Tap a verdict for the full breakdown.

Size at each quantization

Quant Nemotron Nano 9B v2 Nemotron 3.5 Super VL 120B-A12B
Q2_K 3.8 GB* 50.3 GB*
Q3_K_M 4.4 GB* 58.7 GB*
Q4_K_M 6.08 GB 83.96 GB
Q5_K_M 6.4 GB* 85.5 GB*
Q6_K 7.4 GB* 98.4 GB*
Q8_0 8.81 GB 127.5 GB*
FP16 17.79 GB 240 GB*

* derived from bits-per-weight; unstarred sizes are measured GGUF files.

Bottom line

The larger Nemotron 3.5 Super VL 120B-A12B needs ~87.4 GB; Nemotron Nano 9B v2 runs on lighter hardware at ~7.6 GB with more headroom and faster responses. Check each against your exact device: what runs Nemotron Nano 9B v2 · what runs Nemotron 3.5 Super VL 120B-A12B.

More Nemotron comparisons

FAQ

What is the difference in memory between Nemotron Nano 9B v2 and Nemotron 3.5 Super VL 120B-A12B?

At Q4_K_M, Nemotron Nano 9B v2 needs about 7.6 GB and Nemotron 3.5 Super VL 120B-A12B needs about 87.4 GB, a difference of ~79.8 GB.

Should I run Nemotron Nano 9B v2 or Nemotron 3.5 Super VL 120B-A12B?

Run Nemotron 3.5 Super VL 120B-A12B if your hardware has the ~87.4 GB it needs and you want maximum quality; run Nemotron Nano 9B v2 (~7.6 GB) for lighter hardware, faster responses, and more memory headroom.

Full breakdowns: Nemotron Nano 9B v2 · Nemotron 3.5 Super VL 120B-A12B · all models × devices.

Sources

Memory figures are estimates at Q4_K_M. Catalog updated 2026-11-01. See methodology.