Selection bias
Selection bias is systematic distortion in an analysis caused by how observations or participants are selected or retained, producing evidence that does not adequately represent the population or quantity of interest.
Hidden Influences
A distortion that occurs when the observations presented or collected do not accurately represent the population of interest.
- How it is used
- Explains why social media feeds can give a distorted impression of other people’s lives.
- How deep it goes
- Works through how posting frequency and engagement shape a skewed feed.
- Examples
- Uses birthday restaurant posts and professional creators’ polished content as examples.
- What you can do after
- Evaluate how a social media feed can distort perceptions of other people’s lives.
Deep Learning with R, Third Edition
Sampling bias is systematic distortion in measurements caused by a data-collection process that selects examples in relation to the quantity being predicted.
- How it is used
- Diagnoses whether collected training data can support reliable predictions about a broader population or future cases.
- How deep it goes
- Defines the distortion, explains its mechanism, and illustrates it historically, but stops short of detailing correction methods.
- Examples
- Uses the 1948 US presidential election and its unrepresentative phone survey as the central example.
- What you can do after
- Diagnose how a data-collection process can distort measurements and recognize when a sample is not representative.
Read how Deep Learning with R, Third Edition explains selection bias →
Deep Learning with Python, Third Edition
A bias introduced when the data collection process produces a sample that is not representative of the target population.
- How it is used
- Frames nonrepresentative training data as a practical risk in machine-learning data collection.
- How deep it goes
- Defines the mechanism and works through a historical polling example, but does not detail correction methods.
- Examples
- Uses the 1948 US election phone survey and the “DEWEY DEFEATS TRUMAN” headline.
- What you can do after
- Evaluate whether a collection process produces a representative sample before trusting its predictions.
Read how Deep Learning with Python, Third Edition explains selection bias →
Grokking Statistics
Selection bias is systematic distortion caused by including some groups in a sample more readily than others, making those groups overrepresented.
- How it is used
- Evaluates whether a dataset supports trustworthy claims by examining who entered the sample and who may have been omitted.
- How deep it goes
- Defines overrepresentation, works through several survey examples, and gives mitigation questions without developing statistical formulas.
- Examples
- Uses diet testimonials, airline customer polls, and workday political phone calls to show how participation patterns distort findings.
- What you can do after
- Diagnose likely selection bias, disclose its limits, and plan mitigation questions during data collection.
Experimentation for Engineers
Systematic measurement error caused by collecting samples under conditions that differ across the populations or variants being compared.
- How it is used
- Uses randomized sampling to compare system variants without systematically assigning environmental conditions to one variant.
- How deep it goes
- Demonstrates bias with a simulator, repeated means, numerical outputs, and randomized Python measurement.
- Examples
- Uses ASDAQ and BYSE trading costs, morning-versus-afternoon conditions, NumPy simulations, and randomized coin-flip assignment.
- What you can do after
- Diagnose confounded comparisons and apply randomized measurement across changing operating conditions.
Read how Experimentation for Engineers explains selection bias →
Also covered in
What to know first
- supervised learningSupervised learning is a machine-learning approach that learns predictive relationships from examples paired with known target outputs or labels.
Related concepts
- biaskind of · Bias is a systematic tendency or deviation that distorts measurements, estimates, judgments, or outcomes relative to a relevant reference or target.
- samplingproduced by · Sampling is a procedure for selecting items from a collection or generating outcomes from a probability distribution according to a specified rule.
- randomizationcontrasts with · Randomization is the deliberate use of chance to select, assign, arrange, or vary elements of a process, data, or computation.
- Bayesian inferenceuses · Bayesian inference updates probability distributions over hypotheses or unknown quantities by combining prior information with observed evidence and a likelihood model.
- calibration datacontrasts with · Calibration data is data used to estimate or adjust a model’s or system’s parameters, outputs, or behavior for a specified calibration objective.
Questions about selection bias
What is selection bias?
Selection bias is systematic distortion in an analysis caused by how observations or participants are selected or retained, producing evidence that does not adequately represent the population or quantity of interest.
Which Manning books explain selection bias?
Hidden Influences, Deep Learning with R, Third Edition, Deep Learning with Python, Third Edition, Grokking Statistics and Experimentation for Engineers.
What should I know before learning selection bias?
Manning books that teach selection bias usually introduce supervised learning first.
What is the difference between selection bias and randomization?
Selection bias is systematic distortion in an analysis caused by how observations or participants are selected or retained, producing evidence that does not adequately represent the population or quantity of interest. Randomization is the deliberate use of chance to select, assign, arrange, or vary elements of a process, data, or computation.
What is selection bias a kind of?
Selection bias is a kind of bias. Bias is a systematic tendency or deviation that distorts measurements, estimates, judgments, or outcomes relative to a relevant reference or target.
What is selection bias also called?
Selection bias is also called sampling bias.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.




