Decision stump
A decision stump is a decision tree of depth one with a single decision node and prediction leaves.
Grokking Machine Learning, Second Edition
A decision stump is a decision tree consisting of a single feature-based question at the root and prediction leaves beneath it.
- How it is used
- Uses one-question trees to introduce how feature splits make classification and regression predictions.
- How deep it goes
- Defines stump structure, compares classification splits with three criteria, and works through regression cutoffs and mean square error.
- Examples
- Uses jacket decisions, app recommendations by platform or age, COVID-19 symptoms, fraud transactions, and age-based app engagement.
- What you can do after
- Build it from scratch by selecting a one-question classifier using accuracy, Gini impurity, or entropy.
Read how Grokking Machine Learning, Second Edition explains decision stump →
Grokking Machine Learning
A shallow decision tree consisting of a single feature-based split followed by leaf predictions.
- How it is used
- Uses one-question trees to classify examples or predict numerical labels before extending them into deeper decision trees.
- How deep it goes
- Defines the structure, traversal, leaf predictions, and split criteria, but stops short of deeper-tree construction for the stump itself.
- Examples
- Uses a jacket decision, app recommendation by age or platform, fraud screening, illness classification, and age-based engagement prediction.
- What you can do after
- Build it from scratch by selecting a question or cutoff, assigning leaf predictions, and evaluating the resulting classifier or regressor.
Read how Grokking Machine Learning explains decision stump →
Ensemble Methods for Machine Learning
A decision stump is a decision tree of depth one containing one decision node and two leaf nodes.
- How it is used
- Uses one-level trees as simple, efficient base estimators for sequential ensembles such as boosting.
- How deep it goes
- Defines the single-node structure and contrasts its simple functions with deeper trees, without detailing split-selection internals.
- Examples
- Uses axis-parallel tree partitions, weighted training examples, three successive stumps, and a combined boosted ensemble.
- What you can do after
- Apply it via boosting by training stumps sequentially and increasing attention to prior mistakes.
Read how Ensemble Methods for Machine Learning explains decision stump →
What to know first
- accuracyAccuracy is the degree to which a result agrees with a specified truth, reference, or criterion, commonly measured as the proportion of evaluated predictions that are correct.
- classifierA classifier is a predictive model that assigns an input to one or more discrete classes or categories.
- decision treeA decision tree is a tree-structured model or representation in which successive tests or choices lead through branches to outcomes, predictions, or actions.
- inputAn input is information, a value, or an action supplied to a system, program, or computation for processing or to influence its behavior.
Related concepts
- decision treekind of · A decision tree is a tree-structured model or representation in which successive tests or choices lead through branches to outcomes, predictions, or actions.
- AdaBoostused by · AdaBoost is an ensemble-learning algorithm that sequentially combines weak learners, adaptively reweighting training examples so that later learners emphasize those earlier learners handled poorly.
- weak learnerkind of · A weak learner is a predictive model that performs only modestly better than chance or a simple baseline and can contribute to a stronger ensemble.
Questions about decision stump
What is decision stump?
A decision stump is a decision tree of depth one with a single decision node and prediction leaves.
Which Manning books explain decision stump?
Grokking Machine Learning, Second Edition, Grokking Machine Learning and Ensemble Methods for Machine Learning.
What should I know before learning decision stump?
Manning books that teach decision stump usually introduce accuracy, classifier, decision tree and input first.
What is decision stump a kind of?
Decision stump is a kind of decision tree. A decision tree is a tree-structured model or representation in which successive tests or choices lead through branches to outcomes, predictions, or actions.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.


