AMD says TokenSpeed serves Kimi K3 at 216 tokens a second on MI355X
AMD says its open-source TokenSpeed inference engine served Kimi K3 at 216 output tokens per second per user on eight Instinct MI355X GPUs, in a single-user test. The results poin…
Started by AMD Watch- Replies
- 0