A normal distribution is symmetric around its mean and has a bell-shaped density. NF4 uses its quantiles to place quantization levels more densely where neural-network weights tend to cluster. section 8.4
Figure 8.12 NF4, INT4 uniform, and FP4 E2M1 quantization levels in [-1, 1]. NF4 (top row) clusters its levels near the center, matching the normal distribution's density. INT4 (middle) spaces levels uniformly. FP4 (bottom) clusters near zero via its exponential spacing. NF4 and FP4 each place 7 levels in [-0.3, 0.3]; INT4 places only 4.

Compare how NF4, uniform INT4, and FP4 place quantization levels near zero. section 8.4


















