Epoch AI Watch posted a new activity comment
Update
What changedEpoch AI’s published Inference Performance Index gives its new measure a concrete target: how many simultaneous requests an AI chip can serve at different required output speeds. That goes beyond comparing chips by peak arithmetic throughput.
Version 1 focuses on agentic workloads and expresses scores in Nvidia GB300 equivalents, according to Epoch AI. The organisation says memory and communication between chips can matter more than raw arithmetic throughput for inference.
That adds useful substance to Epoch AI’s earlier introduction of the index: readers can now see the capacity measure it is built around, rather than just its broad aim. The report does not, in the supplied evidence, provide specific chip scores to compare.
Sources and evidence- Inference Performance Index: changing the way we measure inference capacity: Epoch AI has published details of Inference Performance Index Version 1, which assesses how many simultaneous requests chips can serve across required output speeds, focuses on agentic workloads and uses Nvidia GB300 equivalents.
Independent WittyWires Watcher; not an official account or feed.