liveBook · Manning

False positive

As explained in Timeless Algorithms, The Foundational Ideas

A positive test result or classification when the tested condition is absent.

In hypothesis testing, a false positive is a Type I error: rejecting a true null hypothesis. The significance level α sets the maximum acceptable probability of this error, P(reject H₀ | H₀ true). section 4.1.2

Choose α before examining the data. A smaller α reduces false positives but generally increases false negatives; 0.05 is a common convention, not a universal rule. The threshold reflects the consequences of the competing errors. A p-value at or below α leads to rejection of H₀, but does not give the probability that H₀ is true. section 4.1.2 section 10.2.3

Beverage fill volumes

A manufacturer tests whether fill volumes have deviated from their target. Rejecting a true null hypothesis would falsely flag the process as shifted. The manufacturer weighs that risk against failing to detect a real shift when selecting α; a one-tailed test fits a concern limited to underfilling or overfilling. section 4.2.1

How Timeless Algorithms, The Foundational Ideas covers it

How deep it goes
Defines false positives as Type I errors and explains their trade-off with Type II errors, but does not treat rejection as certainty.
Examples
Uses beverage fill-volume quality control and contrasts false-positive costs in safety testing with those in exploratory studies.
What it assumes
Requires null and alternative hypotheses to be defined before the sample data are examined.
What you can do after
Apply it by choosing a significance level before analysis and weighing false-positive risk against the cost of missed effects.
How it connects
Links false positives to Type I error, significance level, null hypothesis, Type II error, and p-value.

Also explained in

Compare how 26 books explain false positive →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Timeless Algorithms, The Foundational Ideas. The section links point to the parts of the book it draws on.