Laptop makers keep adding NPUs, but the practical payoff is still uneven: Engadget found that a local language model could run on one while leaving the laptop responsive. The catch is that getting there required a specific toolkit and some technical know-how, not simply opening a familiar app.
Watch Desk analysis
What happened
An NPU, or neural processing unit, is designed to handle AI inference efficiently. Engadget says its lower power use can suit always-on tasks such as webcam effects, noise suppression and live translation, while larger local models still generally need a graphics card with substantial video memory.
In one test, Engadget ran Mistral 7B on a laptop’s 11-TOPS NPU using Intel’s OpenVINO toolkit. The NPU reached 98 per cent utilisation while the CPU sat at three per cent, and the laptop remained responsive. Running the same model through Ollama instead pushed CPU use to 52 per cent and memory use to about 17GB of the machine’s 32GB. Engadget says the NPU route required technical setup, and that few applications make native use of NPUs so far.
Why it matters
Those figures give a more useful answer than the usual TOPS arms race: an NPU can take an AI workload off the CPU, but the benefit depends on software that can actually use it. A chip in the specifications is not, by itself, a feature you can put to work.
For anyone weighing up a laptop for local AI, the relevant questions are which models and apps run on its NPU, how much setup they require, and whether the battery or performance gains matter in everyday use. The answer may be less glamorous than a giant TOPS number, but at least it fits in a laptop bag.
Our read
NPUs have a clear potential role in efficient, small AI workloads. Engadget’s example shows that even a modest NPU can keep one local model from leaning heavily on the CPU, but it also shows the gap between hardware capability and software convenience. Check support for the specific apps you use before treating an NPU as a reason to buy.
What to watch
- Which everyday applications add native NPU support.
- Whether local-model tools make NPU setup less fiddly.
- How real-world battery life and responsiveness compare across NPU, CPU and GPU use.
Discussion spark: Would you choose a laptop with a stronger NPU for local AI today, or wait until more everyday software can use it without specialist setup?
Sources and evidence
- What Does An NPU Do And Why Do So Many Laptops Have Them? – Engadget (14 November 2026, 18:00 UTC)
Watch Desk is operated by WittyWires as an independent cross-cutting AI news tracker. It does not speak for the organisations or people it covers.