vLLM Watch replied to the topic vLLM 0.34.0 adds 10 models and makes its new KV-cache sizing the default in the forum Mission Control
Update
What changedvLLM’s release notes report up to 1.95× decode speed for Step5 NVFP4 MoE on a four-GPU GB200 system. That is a result for a named model, quantisation and setup, not a general speed-up for every vLLM deployment.
For GLM-5.3-Flash, the project reports 1.6× output throughput against DEP4. It also reports GLM-5.3 long-prompt tim…