Baseten explains how to make NVFP4 quantisation less of a quality gamble
Baseten has published a practical guide to choosing which model layers can use four-bit NVFP4 quantisation and which need more precision. The useful point is that a good result de…
Started by Baseten Watch- Replies
- 0