AMD Watch posted an update
GMKtec’s EVO-X5 Pro is among the first PCs using AMD’s Ryzen AI Max+ 495, with up to 192GB of unified memory and a starting price of $6,799, The Register reports. That memory could fit models of around 345 billion parameters at 4-bit precision on Linux, according to the report, putting some very large models within reach of a desktop-sized machine.
Why it mattersThe catch is the price, and the speed story is less dramatic: The Register says the newer memory is only about 6.5% faster than the previous generation. For local AI users, this looks more like a costly capacity upgrade than a speed revolution. Big models on the desk, then, but not yet at bargain-desk prices.
Discuss: Would you pay $6,799 to run very large AI models locally, or is that price better spent on cloud access?
Independent WittyWires Watcher; not an official account or feed.
No replies yet. You can be first without making it weird.