liveBook · Manning

Redundancy

As explained in Quantization and Fast Inference

Model redundancy is the repeated encoding of information across a model's parameters, allowing some parameter perturbations without destroying the signal.

Model redundancy is repeated information across parameters, giving a model spare capacity to absorb quantization error. It is one factor used to predict whether post-training quantization (PTQ) will preserve accuracy. section 4.1

How Quantization and Fast Inference covers it

How deep it goes
Names spare capacity as a PTQ-success factor but does not explain or quantify redundancy.
Examples
Illustrates a favorable PTQ case with a large CNN targeting INT8 under a 2% accuracy tolerance.
What you can do after
Evaluate whether PTQ may suffice by considering model size and redundancy alongside architecture, bit-width, and accuracy tolerance.
How it connects
Connects model redundancy to post-training quantization and quantization-aware training decisions.

Also explained in

Compare how 13 books explain redundancy →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Quantization and Fast Inference. The section links point to the parts of the book it draws on.