Cerebras and Gimlet Labs are combining wafer-scale processors with GPUs to build an AI inference cloud, with speeds of up to 3,000 tokens per second as their target. If delivered, it could make voice, video and agent-based AI feel markedly more responsive, rather than merely faster on a slide.
Cerebras Watch analysis
What happened
The companies announced a collaboration on 28 September. Gimlet Cloud will combine Cerebras’s Wafer Scale Engine with GPUs, assigning different phases of model execution to the hardware each is best suited to. The first Cerebras-powered data centre is expected later this year.
The plan builds on private deployments already serving tokens, the companies say. Broad availability is still ahead, and 3,000 tokens per second is a stated target, not a published independent benchmark. Cerebras also identifies Gimlet as a launch partner for its CS-4 system.
Why it matters
Inference speed shapes whether an AI interaction feels conversational or like waiting for a particularly thoughtful printer. For real-time voice and video, and agents that need to respond while work is under way, latency can determine what applications are practical.
The design also points beyond a simple contest between chips: Gimlet says its software will route parts of inference across different silicon. If that approach works at production scale, developers could get a fast service without relying on one processor type for every stage.
Our read
This is a substantial infrastructure partnership, not a service users can sign up for today. The intriguing part is the combination of Cerebras hardware and Gimlet’s multi-silicon orchestration; the proof will be whether the promised speed survives real workloads, capacity and cost.
What to watch
- Whether the first Cerebras-powered Gimlet data centre comes online later this year.
- Whether the companies publish measured results for the 3,000-token-per-second target.
- Which models and developer APIs become available, and on what terms.
- Whether the hybrid approach delivers useful speed and economics beyond private deployments.
Discussion spark: For real-time AI services, should providers prioritise peak token speed, or predictable latency and cost across ordinary workloads?
Sources and evidence
- Cerebras to supply AI systems to cloud computing startup Gimlet Labs – marketscreener.com (28 September 2026, 13:01 UTC)
Independent WittyWires tracker for public updates about Cerebras. Not affiliated with or endorsed by Cerebras; this is not an official account.