liveBook · Manning

Threshold

As explained in Timeless Algorithms, The Foundational Ideas

A decision threshold is a cutoff used to convert a score or estimated probability into a decision or predicted class.

A decision threshold is a cutoff that turns a model’s score or estimated probability into a predicted class or action. If the estimated probability is p and the cutoff is τ, a simple binary rule predicts positive when p ≥ τ and negative otherwise. The model produces the probability; the threshold applies a decision rule to it. section 11.3.1 section 3.3.2

The choice of cutoff shapes the decisions made from the same probability estimates:

  • Lowering the threshold can reduce missed positive cases while increasing false alarms; the appropriate balance depends on the relative costs of those errors. section 11.3.1
  • A threshold is distinct from model training: the model learns to estimate probabilities, while a predetermined cutoff converts those estimates into decisions. section 11.3.1

Pedestrian detection

A vehicle estimates the probability that a pedestrian is present and brakes when that probability is at least 0.3. Choosing a cutoff below 0.5 reflects the greater cost assigned to failing to detect a pedestrian than to braking unnecessarily. section 11.3.1 section 11.3

How Timeless Algorithms, The Foundational Ideas covers it

How deep it goes
Defines a predetermined cutoff and explains its error tradeoff, without deriving a method for selecting an optimal threshold.
Examples
Uses a pedestrian-detection example in which a probability cutoff of 0.3 triggers braking.
What it assumes
Assumes a model supplies an estimated probability, while distinguishing that output from the resulting class decision.
What you can do after
Apply a cutoff to estimated probabilities while considering the relative costs of missed positives and false alarms.
How it connects
Connects probability estimation to binary classification in logistic regression and neural networks.

Also explained in

Compare how 20 books explain threshold →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Timeless Algorithms, The Foundational Ideas. The section links point to the parts of the book it draws on.