Signal-to-noise ratio compares a desired signal’s magnitude or power with accompanying noise. In post-training quantization (PTQ), it shows how much quantization noise grows as precision falls. section 4.1
The decline is steep rather than gradual: at INT8, quantization noise is about 16,000 times smaller than the signal; at INT4, it is only about 50 times smaller. The lower ratio helps explain why INT8 PTQ often succeeds, while INT4 commonly needs group quantization to preserve resolution. section 4.1
Figure 4.1 Left: Signal-to-Noise ratio by bit-width with PTQ viability zones. Right: Signal-to-noise ratio as intuitive ratios

Compare signal-to-noise ratios across bit-widths and their intuitive interpretations. section 4.1

