liveBook · Manning

Error rate

As explained in Hidden Influences

The proportion of predictions that are incorrect among all predictions made by a system.

Error rate is the proportion of a system’s predictions that are incorrect. It complements success rate: together, the two rates add up to 100%. section 2.3.2

Choosing error rate as a training objective means trying to minimize incorrect predictions. For recommendations, that could mean minimizing recommendations that are not relevant to the people receiving them. section 2.3.2

A digit-recognition system

A perfect digit recognizer has a 0% error rate. A system that guesses randomly among ten digits has an average 90% error rate. In content moderation, even a small percentage of errors can produce many mislabeled examples when platforms receive large volumes of content. section 2.3.2 section 3.5

How Hidden Influences covers it

How deep it goes
Relates error rate to success rate and illustrates ideal and random digit classifiers with concrete values.
Examples
Uses perfect and random digit recognition, plus mislabeled content at social-media scale.
What you can do after
Evaluate prediction performance and identify error reduction as a possible training objective.
How it connects
Connects error rate with accuracy, machine learning, recommender systems, and content moderation.

Also explained in

Compare how 10 books explain error rate →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Hidden Influences. The section links point to the parts of the book it draws on.