vLLM Watch
vLLM has added bi-directional KV-cache transfer for multi-turn AI workloads, letting prefill servers reuse context held by decode servers instead of repeatedly computing it. In AWS’s benchmark, the change cut time to first token by up to 3.3 times for one tested model, though the gains depend on…
Meta AI Watch
Meta has unveiled new networking designs for AI data centres, including a liquid-cooled switch rack and a fabric intended to connect larger GPU clusters with fewer network hops. The announcement also includes open implementations and a new standards initiative, putting infrastructure choices that are usually buried in the…
Watch Desk
Prime Intellect’s Prime Agent has been rewritten in Rust, adding native Windows support and on-disk session persistence alongside claimed gains in speed and memory use. The release is a substantial change for people building AI agents, though the performance figures come from the account of the release and…
Meta AI Watch
Meta says it is using otherwise idle capacity across its inference fleet to improve ad recommendations, while keeping the computing power reserved for ordinary service protected. The approach offers a practical way to do more AI work with hardware already in the system, rather than ordering more capacity.
AWS AI Watch
Amazon Web Services researchers say a technique called priming can turn pretrained Transformer weights into hybrid models that combine attention with state space layers, cutting the cost of pretraining those hybrids by over 99%. They also report that the resulting models matched the source Transformers’ reasoning benchmarks and…
Watch Desk
Three US Democratic senators have introduced a bill to create an AI Safety Board within the Department of Commerce. It would set up technical evaluations of AI systems that could threaten national or economic security, putting a concrete oversight proposal on the table as Congress debates how to…
Microsoft AI Watch
Microsoft researchers have introduced StudentSim, a system that simulates how individual learners respond to questions and tutoring. In tests across chess, English writing and maths, it outperformed the reported baselines, and a chess tutoring experiment suggests simulated student feedback could help improve tutors before they are tested with…
NVIDIA Watch
NVIDIA and Princeton’s Dao AI Lab have developed ReplaySSM, a method for speeding up inference in hybrid AI models by changing how their state is stored. NVIDIA reports up to 1.80× faster SSM decoding kernels at batch size 256, with larger gains for speculative decoding on tested 120B-class…
Meta AI Watch
Meta has launched Muse Wonder and Muse Wonder Full, adding two models aimed at demanding coding and agent tasks. Wonder is available through Meta’s Model API and Muse Code, while Wonder Full is exclusive to Muse Code subscribers.
Watch Desk
ASUS has unveiled a compact server built around NVIDIA Vera CPUs for agentic AI and reinforcement-learning workloads. The XA P2N-E2 is designed to handle the less glamorous, essential work around AI models: running code, using tools, sandboxing tasks and processing data.
Watch Desk
Businesses scaling AI should track what it costs, what value it creates and where each task should run, argues HP executive Neil Sawyer. His case for combining cloud and local AI offers a practical alternative to sending every task to the cloud by default.
Unsloth Watch
Unsloth’s new beta lets local and hosted models browse the web, while adding several useful tools for training and running models on personal hardware. The browser controls and performance changes make this a substantial update for people building local AI workflows, not just another dot on a release…
Alibaba Qwen Watch
Alibaba researchers have detailed QwenGyre, a framework for training AI agents on long software-engineering tasks. It dynamically shifts GPUs between generating agent runs and training, targeting expensive stretches when hardware would otherwise sit idle.
Watch Desk
The UK’s AI minister says a breach of British cyber defences by AI is “likely, if not inevitable”, and says government researchers are evaluating advanced systems including Google’s Gemini. His warning comes alongside plans to prepare for threats involving autonomous agents, though the report describes no specific new…
Marvell Technology Watch
Marvell has announced two CXL 3.2 memory expanders for AI infrastructure, adding six memory channels and support for sharing memory across as many as four hosts. The company says the new Structera X controllers can expand capacity for larger models and longer context windows, with sampling expected in…
Watch Desk
The UK government plans to use advanced AI to help defend public systems and is exploring stronger rules for identifying and reporting serious AI-related cyber incidents. AI minister Kanishka Narayan also says the government wants its security researchers to keep access to leading AI models before release, so…
Watch Desk
Defra says it used AI to turn two days’ worth of workshop material into interactive online learning in less than a day. The trial shows how the department hopes to make staff expertise easier to share, while leaving subject-matter experts in charge of judgement and review.
DeepSeek Watch
A community plugin called DeepSeek Bot adds multiple bots, persistent memory and group chats to DeepSeek Harness, with its data stored on the user’s own computer. It offers Harness users a practical way to experiment with AI teams, though the project is independent of DeepSeek itself.
Advantech Watch
Advantech and Leopard Imaging are showing a machine-vision system that runs camera capture and AI inference locally on an edge computer. The demo combines four live camera feeds with person detection across eight additional video streams, without sending the video to the cloud.
AWS AI Watch
AWS has released Strands Box, an open-source sandbox that checks what AI agents do, not just what they can access. It is in developer preview for Macs with Apple silicon, with Linux support planned, and offers a practical way to put rules around agents that run commands, call…