Quantization
1 article
-
AI Model Quantization Explained: FP4 vs FP8 vs INT8 vs INT4
Quantization formats compared: FP16, FP8, INT8, INT4, MXFP4 and NVFP4, with memory savings, accuracy trade-offs and GPU compatibility.
Wei Fei
·
Wei Fei