In tensor-wise quantization, one unusually large value sets the scale for every value in the tensor, potentially erasing distinctions among smaller values. section 5.6.2
A single value can erase differences
Quantizing [2.0, 3.0, 500.0] to 8-bit integers with a shared scale produces [1, 1, 127]. The first two values become indistinguishable; dequantization gives approximately [3.94, 3.94, 500.0]. section 5.6.2
Fine-grained quantization limits an outlier’s effect by scaling smaller groups independently. A large value in one group then does not determine the scale for values in other groups. section 5.6.2 section 5.6.4
Figure 5.27 Fine-Grained Quantization for an activation vector. The vector is partitioned into smaller groups. Each group is scaled independently based on the maximum value within that group, preserving precision for values in groups that do not contain large outliers.

The activation-vector diagram shows how independent group scales protect values in groups without large outliers. section 5.6.2



















