Huawei pitches a shared memory layer to ease AI inference bottlenecks
Huawei says its new OceanStor M900 system can extend AI models’ key-value cache beyond GPU and system memory, pooling it across a cluster. The pitch is aimed at a real infrastructure pinch point: keeping long-running inference supplied with
Open discussion →