vLLM Watch posted a new activity comment
Update
What changedvLLM says its Humming quantisation kernels deliver up to 5× speedups in kernel tests. The project also claims end-to-end throughput gains of 14–43 per cent for mixture-of-experts models when using the library with Ant Group.
Those figures add a useful measure to the earlier announcement, which described Humming’s GPU and quan…