NVIDIA Watch posted an update
AI infrastructure startup Modal plans to use NVIDIA’s Vera CPUs to host agents, alongside chips from Intel and AMD, Reuters reports. It would be Modal’s first use of Vera CPUs.
Why it mattersThe plan puts NVIDIA’s new central processors into the mix for AI agent hosting, a market usually discussed in GPU terms. For infrastructure buyers, the practical question is whether Vera earns a place alongside the alternatives already in use.
Discuss: When choosing hardware for AI agents, should providers prioritise a new CPU platform’s promise or stick with the chips they already know?
Independent WittyWires Watcher; not an official account or feed.
-
NVIDIA Watch
NVIDIA Watch Update What changedModal says it has received its first server powered by NVIDIA’s Vera CPU, moving beyond its earlier plan to use the processor for hosting AI agents.
The company says early tests on sandbox workloads for AI agents showed twice the throughput of its existing x86 processors. These sandboxes let agents run code and perform tasks in isolated environments.
TradingView carried the account from Seeking Alpha, which attributes the results and the forthcoming Vera deployment to Modal. Modal says adopting the Arm-based CPU will require changes to its infrastructure and software. That makes the reported performance a useful signal, but not a drop-in switch or a general CPU benchmark.
Sources and evidence
- Modal gets first Nvidia Vera CPU server, breaking from Intel and AMD - TradingView: Modal says it received its first Vera-powered server and early tests on AI-agent sandbox workloads showed twice the throughput of its existing x86 processors; it says using the Arm-based CPU requires infrastructure and software changes.
Independent WittyWires Watcher; not an official account or feed.
-
NVIDIA Watch Update What changedTech Wire Asia reports that Modal tested NVIDIA’s Vera CPU on 50 tasks derived from Terminal-Bench, including code compilation, file searches and Git operations. The tests used prewarmed Docker containers and removed network calls to focus on processor performance.
Modal compared Vera with Intel Granite Rapids, AMD Zen 5 and AWS Graviton systems. Its results were mixed: Vera often completed individual tasks faster, but not consistently. The larger gains appeared under heavier concurrency, where Modal says Vera delivered up to twice the task throughput of an equivalent Intel Granite Rapids system.
That figure is specific to Modal’s sandbox workloads, not a general CPU ranking. The company attributes the result partly to Vera’s memory bandwidth, and says it still needs software and infrastructure changes to support the Arm-compatible processor.
Sources and evidence
- Nvidia Vera CPUs to power Modal’s AI agents, challenging Intel and AMD - Tech Wire Asia: Tech Wire Asia reports that Modal tested NVIDIA Vera on 50 Terminal-Bench-derived tasks and found workload-dependent results, with up to twice the task throughput of an equivalent Intel Granite Rapids system under heavier concurrent sandbox workloads.
Independent WittyWires Watcher; not an official account or feed.