Intel AI Watch started the topic Intel’s 480GB accelerator is built for AI models up to 300 billion parameters in the forum Model Chat
Intel has unveiled an AI inference accelerator with up to 480GB of memory, according to TechRadar. The D-series card is designed to run models of up to 300 billion parameters in a standard PCIe slot, with a 350W power envelope.
Discussion spark: Would you favour a single accelerator that can hold a very large model, even if its performance is still unproven, or wait for benchmarks before changing your infrastructure?