Best local AI models for the Ryzen AI Max+ 395 128 GB
128 GB of unified memory and 256 GB/s of bandwidth, for about $3,300. The most capable model that fits with 32K context is Qwen3.8 27B (capability 152), at about 10.9 tokens a second. 13 of 14 models fit.
Every model on the Ryzen AI Max+ 395 128 GB
Usual quantisation
| Model | Capability | 8K | 32K | 128K | Speed at 32K |
|---|---|---|---|---|---|
| Qwen3.8 27BQ4_K_M, 20 GB at 32K | 152 | Fits | Fits | Fits | 10.9 tok/s |
| Qwen3.6 35B-A3BQ4_K_M, 23 GB at 32K | 144 | Fits | Fits | Fits | 61 tok/s |
| Gemma 4 31BQ4_K_M, 23 GB at 32K | 143 | Fits | Fits | Fits | 9.5 tok/s |
| Gemma 4 26B-A4BQ4_K_M, 18 GB at 32K | 142 | Fits | Fits | Fits | 46 tok/s |
| gpt-oss-120bMXFP4 (gpt-oss native), 66 GB at 32K | 140 | Fits | Fits | Fits | 40 tok/s |
| Qwen3.5 9BQ4_K_M, 7.6 GB at 32K | 139 | Fits | Fits | Fits | 30 tok/s |
| gpt-oss-20bMXFP4 (gpt-oss native), 13 GB at 32K | 138 | Fits | Fits | Fits | 54 tok/s |
| Llama 3.3 70BQ4_K_M, 55 GB at 32K | 127 | Fits | Fits | Fits | 3.8 tok/s |
| Nemotron 3.5 Lightning 30B-A3BQ4_K_M, 20 GB at 32K | — | Fits | Fits | Fits | 76 tok/s |
| Mistral Small 4 119B-A6BQ4_K_M, 77 GB at 32K | — | Fits | Fits | Fits | 33 tok/s |
| Qwen3.5 122B-A10BQ4_K_M, 77 GB at 32K | — | Fits | Fits | Fits | 27 tok/s |
| Nemotron 3 Super 120B-A12BQ4_K_M, 76 GB at 32K | — | Fits | Fits | Fits | 24 tok/s |
| Muse Glimmer 30BQ4_K_M, 23 GB at 32K | — | Fits | Fits | Fits | 9.5 tok/s |
| Qwen3.5 397B-A17BQ4_K_M, 248 GB at 32K | 147 | Won’t fit | Won’t fit | Won’t fit | — |
Estimates from memory size and bandwidth, calibrated against published llama.cpp results. Capability: Epoch Capabilities Index by Epoch AI, CC BY 4.0, read 4 Nov 2026.
Similar-priced hardware
| Hardware | Memory | Bandwidth | Price (about) | Best model at 32K |
|---|---|---|---|---|
| Ryzen AI Max+ 395 128 GB | 128 GB | 256 GB/s | $3,300 | Qwen3.8 27B (152) |
| RTX 5080 | 16 GB | 960 GB/s | $1,600 | Qwen3.5 9B (139) |
| RTX 4090 (used) | 24 GB | 1008 GB/s | $2,250 | Qwen3.8 27B (152) |
| Radeon AI PRO R9700 | 32 GB | 640 GB/s | $1,650 | Qwen3.8 27B (152) |
| Mac Studio M5 Max 128 GB | 128 GB | 614 GB/s | $4,500 | Qwen3.8 27B (152) |
Questions
What is the best local LLM for the Ryzen AI Max+ 395 128 GB?
The highest-scoring model that fits with 32K tokens of context is Qwen3.8 27B (capability 152), at an estimated 10.9 tokens a second. For speed, Nemotron 3.5 Lightning 30B-A3B runs at about 76 tokens a second.
How many models fit on the Ryzen AI Max+ 395 128 GB?
13 of the 14 models we track fit in its 128 GB with 32K context, and 13 with 8K. 13 fit with 128K tokens of context for long documents.
What does the Ryzen AI Max+ 395 128 GB cost to run?
At about 130 W under load and $0.25 per kWh, about $0.03 an hour of generation. Against the API price of Qwen3.8 27B, at 4M input and 1M output tokens a day it would pay for itself in about 4217 months.