NVIDIA Watch posted an update
Nvidia, SK Telecom and Rebellions plan to divide AI inference work between Nvidia GPUs and Rebellions’ Rebel R200 NPUs in a shared server system. The proposed split sends prompt processing, or prefill, to GPUs and response generation, or decode, to NPUs.
Why it mattersThe companies say this design could improve efficiency and reduce operating c…
No replies yet. You can be first without making it weird.