Occam's razor
Occam’s razor is the principle that, among explanations or models with comparable adequacy, the simpler one—with fewer assumptions or unnecessary complexity—is preferable.
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
Occam's razor principle favors the hypothesis that explains the evidence with the fewest assumptions among competing hypotheses.
- How it is used
- Guides data-science teams toward the simplest approach that solves a prediction or automation problem.
- How deep it goes
- Explains model-choice rationale and trade-offs, but stops short of formal philosophical analysis.
- Examples
- Compares linear regression, support vector machines, conventional code, XGBoost, and Keras for Airbnb NYC price prediction.
- What you can do after
- Evaluate competing solutions and choose a simpler model when it meets the problem’s needs.
Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains Occam's razor →
Sutskever's List
Occam's razor is the principle of preferring the simplest explanation that adequately accounts for the observations.
- How it is used
- Guides preference among explanations consistent with observations during inductive inference.
- How deep it goes
- Defines the principle and illustrates it with a number sequence and pattern-matching questions.
- Examples
- Compares predictions of 9 and 33 for 1, 3, 5, 7, and mentions intelligence-test pattern questions.
- What you can do after
- Evaluate competing explanations by preferring the simplest one that fits the observations.
Delivering Machine Learning Projects: From design to deployment
Occam's razor is the principle of preferring the simplest explanation or model when alternatives have otherwise comparable adequacy.
- How it is used
- Guides model selection when candidates have comparable effectiveness and stakeholders must balance simplicity, interpretability, and performance.
- How deep it goes
- Explains simplicity through model size, parameter count, compression, and decision-tree splits, but avoids formal mathematical treatment.
- Examples
- Uses sensor-failure trees, age-based and location-based splits, XGBoost baselines, and simpler explainable models.
- What you can do after
- Evaluate model candidates by comparing effectiveness, complexity, interpretability, and nonfunctional performance.
Read how Delivering Machine Learning Projects: From design to deployment explains Occam's razor →
Also covered in
- Grokking BayesIn early access (MEAP)
- Machine Learning Algorithms in Depth
What to know first
- regularizationRegularization is a modeling technique that constrains learning or penalizes model complexity to discourage overfitting and improve generalization.
Related concepts
- bayes factorimplemented by · A Bayes factor is the ratio of the marginal likelihoods of two competing models or hypotheses, quantifying their relative support from observed data.
- decision treeconfigures · A decision tree is a tree-structured model or representation in which successive tests or choices lead through branches to outcomes, predictions, or actions.
- model compressionuses · Model compression is the reduction of a machine-learning model’s size, memory use, or computational requirements while retaining useful behavior or performance.
Questions about Occam's razor
What is Occam's razor?
Occam’s razor is the principle that, among explanations or models with comparable adequacy, the simpler one—with fewer assumptions or unnecessary complexity—is preferable.
Which Manning books explain Occam's razor?
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI, Sutskever's List and Delivering Machine Learning Projects: From design to deployment.
What should I know before learning Occam's razor?
Manning books that teach Occam's razor usually introduce regularization first.
What is the difference between Occam's razor and principle of multiple explanations?
Occam’s razor is the principle that, among explanations or models with comparable adequacy, the simpler one—with fewer assumptions or unnecessary complexity—is preferable. The principle of multiple explanations holds that hypotheses consistent with available evidence should not be discarded solely on logical grounds.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.


