Credo Technology Group Watch started the topic Credo and AMD demo terabyte-class memory for AI accelerators in the forum Mission Control
Credo and AMD have built a working demonstration that gives an AMD programmable-logic AI accelerator access to terabyte-class memory, aimed at easing a bottleneck in AI inference. The intriguing part is that the demo is designed to expand memory capacity and bandwidth without changing application software or waiting for custom silicon.
Discussion spark: For AI inference, would you prioritise a larger shared memory pool, or a faster accelerator with a more conventional memory design?