liveBook · Manning

False positive

As explained in Outlier Detection in Python

A prediction that an issue exists when no issue is present.

A false positive occurs when an outlier detector flags an issue that is not actually present. For a labeled record, it means predicting “outlier” when the record is an inlier. This differs from a false negative, which misses an issue that is present. A statistically unusual record is not necessarily a useful finding: whether a flag is false depends on the purpose of the investigation. section 1.1.5 section 14.0

Sensor readings

A temperature-monitoring system compares current readings with data representing normal operation. It may flag unusually high or low fluctuations for investigation, but a flag alone does not establish a process fault. Deciding how many readings to investigate means balancing false positives against missed issues. section 1.1.5

False positives become more likely or more consequential in several settings:

  • Examining many combinations of features can surface entities or time periods that are unusual by chance rather than interesting anomalies. section 12.6.5
  • With very few rows, a record may look unusual simply because similar examples are absent from the available data; many features increase the risk of spurious findings. section 10.3

Evaluate flags in the context of the available investigation effort. Precision at k asks how many of the top k records investigated are actual outliers; an alternative counts how many records must be examined to find k true outliers. For systems that need binary labels, first seek good score ranking, then choose a threshold suited to the relative importance of false positives and false negatives. Ensembles of outlier detectors offer another way to reduce both kinds of error, though useful ground-truth labels are difficult to establish consistently. section 8.5.2 section 14.0

How Outlier Detection in Python covers it

How deep it goes
Defines the labeling error and discusses evaluation and practical causes, without deriving a false-positive-rate formula.
Examples
Uses temperature-sensor fluctuations, purchasing-feature combinations, and small datasets to illustrate flags that may not represent meaningful anomalies.
What it assumes
Defines positive and negative outlier labels explicitly and requires comparison data representing typical operation.
What you can do after
Evaluate/understand flagged outliers against investigation capacity, ranking quality, and the risk of chance findings.
How it connects
Links false positives to false negatives, outlier detection, precision at k, score thresholds, and detector ensembles.

Also explained in

Compare how 26 books explain false positive →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Outlier Detection in Python. The section links point to the parts of the book it draws on.