Hardware guide · Sarvam
S What hardware do you need to run Sarvam-105B?
Sarvam-105B needs about 67.5 GB to run at Q4_K_M, so the lightest hardware that runs it is Apple M4 Max (128GB). 4 of 40 devices tested can run it.
- Needs (Q4_K_M)
- ~67.5 GB
- Devices that run it
- 4
- Too small
- 36
- Lightest that runs it
- ~96 GB
Recommended Q4_K_M
Runs at Q4_K_M using ~67.5 GB of ~96 GB usable.
What kind of hardware runs Sarvam-105B
Of the 4 devices that run it, here is the split by hardware class.
1 discrete GPU 3 Macs
Hardware that runs Sarvam-105B
Ranked by usable memory, lightest first. Prices are approximate street prices for the device itself (a GPU is the card alone; a Mac is the whole machine). Tok/s is a bandwidth estimate; see methodology.
Compatible devices 4 total
Too small for Sarvam-105B
Apple M4 Max (64GB) Apple M4 Pro (48GB) Apple M5 Pro (48GB) Nvidia GeForce RTX 5090 (32GB) 32GB RAM Laptop (CPU/iGPU only) Nvidia GeForce RTX 4090 (24GB) Nvidia GeForce RTX 3090 (24GB) AMD Radeon RX 7900 XTX (24GB) Apple M5 (32GB) Apple M4 (24GB) Apple M4 Pro (24GB) Nvidia GeForce RTX 4060 Ti (16GB) Nvidia GeForce RTX 4080 (16GB) Apple M3 Pro (18GB) 16GB RAM Laptop (CPU/iGPU only) iPad Pro M4 (16GB, 1TB/2TB config) Samsung Galaxy S25 Ultra (16GB, 1TB config only) Samsung Galaxy S26 Ultra (16GB, 1TB config) Nvidia GeForce RTX 3060 (12GB) Nvidia GeForce RTX 4070 (12GB) Apple M2 (16GB) Apple M4 (16GB) Google Pixel 9 Pro Apple M5 (16GB) Google Pixel 10 Pro Samsung Galaxy S24 Ultra Generic Android Phone (12GB RAM) iPhone 17 Pro iPhone Air Apple M1 (8GB) 8GB RAM Laptop (CPU/iGPU only) iPhone 15 Pro iPhone 16 iPhone 16 Pro Generic Android Phone (8GB RAM) iPhone 17
See the full Sarvam-105B memory breakdown, or compare it against other models.
Sources
Memory at Q4_K_M (67.5 GB = 64.2 GB weights + KV cache + overhead), validated 2026-08-03. See methodology.