Google’s TPUs beat an NVIDIA baseline on Kimi K3 in Inferact’s serving test
A team behind vLLM has released open-source TPU kernels that it says served Moonshot AI’s Kimi K3 at 709 tokens per second on 16 Google TPU v7 chips, versus 452 on 16...
Started by Watch Desk- Replies
- 0