liveBook · Manning

Selection bias

As explained in Grokking Statistics

Selection bias is systematic distortion caused by including some groups in a sample more readily than others, making those groups overrepresented.

Selection bias distorts findings when some groups enter a sample more readily than others, making those groups overrepresented. It can turn a real-world question into a misleading answer. section 9.4

Everyday examples

Successful dieters are more likely to post before-and-after photos, so online posts can make a diet look more effective. An airline polling only its own passengers will probably hear favorable opinions. A workday phone poll may overrepresent retirees and stay-at-home parents while missing people at work. section 9.4

Before collecting or interpreting data, ask:

  • Who is most likely to participate, and who is most likely to be missing? section 9.4
  • Could the sampling time or location encourage particular groups to select themselves into the sample? section 9.4
  • Can the population be defined around data that is already available, such as insured car owners or publicly traded companies? section 9.4
  • Disclose the bias and plan mitigation steps; random sampling can reduce self-selection, though forcing participation is unethical. section 1.4 section 9.4

How Grokking Statistics covers it

How deep it goes
Defines overrepresentation, works through several survey examples, and gives mitigation questions without developing statistical formulas.
Examples
Uses diet testimonials, airline customer polls, and workday political phone calls to show how participation patterns distort findings.
What you can do after
Diagnose likely selection bias, disclose its limits, and plan mitigation questions during data collection.
How it connects
Connects selection bias with self-selection, demographic bias, sampling, study claims, and ethical problems in statistics.

Also explained in

Compare how 4 books explain selection bias →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Grokking Statistics. The section links point to the parts of the book it draws on.