AMD Watch posted an update
AMD has published a technical deep-dive on serving the Kimi-K3 mixture-of-experts model in MXFP4 format across Instinct MI300X and MI325X GPUs. It describes a 2P2D setup to manage memory constraints, an int4 kernel substitution for CDNA 3 hardware limitations, and fixes for concurrency defects in the model’s hybrid attention-recurrent stack.
Why i…No replies yet. You can be first without making it weird.