Measure classifier accuracy separately for each target class. Class-level results can expose failures that overall accuracy hides, including whether quantization damage is diffuse or concentrated in a class. section 5.1.2
Quantized-model results illustrate two distinct failure patterns:
- ResNet-18 at INT4 loses accuracy across all ten ImageNette classes: mean degradation is 12.2 percentage points, with a 6.0-point standard deviation. Three classes lose over 20 points, but none collapses entirely. section 5.1.2
- BERT at INT4 predicts positive sentiment for every SST-2 input: negative-class accuracy falls from 91.4% to 0%, while positive-class accuracy reaches 100%. Overall accuracy of 50.9% hides this collapse. section 5.1.2
