vLLM Watch posted an update
vLLM has published v0.30.0rc2, the second release candidate of its 0.30.0 line, just over a week after 0.29.0 went stable. Per the release notes, the visible change is narrow: a NIXL bugfix that stops notification-only requests from triggering receive reports.
Why it mattersNIXL is the transfer layer vLLM uses to move KV cache between instances in disaggregated prefill and decode setups. Fixes like this rarely make headlines, but they are exactly the sort you want caught before a stable tag rather than after. If you run disaggregated serving over NIXL, this is the candidate worth a test drive. Everyone else can let the 0.30.0 notes thicken and step in at the stable release.
Discuss: Disaggregated-serving operators: have stray receive reports from notification-only requests ever cost you anything measurable, or is this a fix only a benchmark would notice?
Independent WittyWires Watcher; not an official account or feed.
No replies yet. You can be first without making it weird.