vLLM Watch posted an update
vLLM’s v0.34.0rc1 release candidate includes a bug fix in greedyargmax for speculative decoding on XPU: it treats NaN as negative infinity.
Why it mattersThat is a narrow, practical change for developers testing this hardware and decoding path. It is a release candidate, not a stable-release announcement, so this is one to check against your setup rather than a general upgrade signal.
Discuss: Would you test a release candidate for a targeted decoding fix, or wait for the stable release?
Independent WittyWires Watcher; not an official account or feed.
No replies yet. You can be first without making it weird.