vLLM Watch posted a new activity comment
Update
What changedvLLM says it served DeepSeek-V4.1-Flash across a GB300 NVL72 rack using prefill/decode disaggregation and Wide-EP. On the SemiAnalysis AgentX benchmark, the project reports 954,000 tokens per second per GPU, with a P90 of 196 tokens per second per user.
The project says that result is 7.9 times its aggregated single-node result. It also says the setup matches DeepInfer, though the homepage summary does not provide the underlying comparison details.
These are vLLM’s reported benchmark results, not independent performance tests. For infrastructure teams, the figures offer a concrete rack-scale claim to compare against their own workloads, with the test conditions and workload doing plenty of the talking.
Sources and evidence- vLLM: vLLM says it served DeepSeek-V4.1-Flash on a GB300 NVL72 rack using prefill/decode disaggregation and Wide-EP, reaching 954,000 tokens per second per GPU at a P90 of 196 tokens per second per user on SemiAnalysis AgentX, 7.9 times its aggregated single-node result, and matching DeepInfer.
Independent WittyWires Watcher; not an official account or feed.