liveBook · Manning

Decision stump

A decision stump is a decision tree of depth one with a single decision node and prediction leaves.

How 3 Manning books explain it

Grokking Machine Learning, Second Edition

A decision stump is a decision tree consisting of a single feature-based question at the root and prediction leaves beneath it.

How it is used
Uses one-question trees to introduce how feature splits make classification and regression predictions.
How deep it goes
Defines stump structure, compares classification splits with three criteria, and works through regression cutoffs and mean square error.
Examples
Uses jacket decisions, app recommendations by platform or age, COVID-19 symptoms, fraud transactions, and age-based app engagement.
What you can do after
Build it from scratch by selecting a one-question classifier using accuracy, Gini impurity, or entropy.

Read how Grokking Machine Learning, Second Edition explains decision stump →

Grokking Machine Learning

A shallow decision tree consisting of a single feature-based split followed by leaf predictions.

How it is used
Uses one-question trees to classify examples or predict numerical labels before extending them into deeper decision trees.
How deep it goes
Defines the structure, traversal, leaf predictions, and split criteria, but stops short of deeper-tree construction for the stump itself.
Examples
Uses a jacket decision, app recommendation by age or platform, fraud screening, illness classification, and age-based engagement prediction.
What you can do after
Build it from scratch by selecting a question or cutoff, assigning leaf predictions, and evaluating the resulting classifier or regressor.

Read how Grokking Machine Learning explains decision stump →

Ensemble Methods for Machine Learning

A decision stump is a decision tree of depth one containing one decision node and two leaf nodes.

How it is used
Uses one-level trees as simple, efficient base estimators for sequential ensembles such as boosting.
How deep it goes
Defines the single-node structure and contrasts its simple functions with deeper trees, without detailing split-selection internals.
Examples
Uses axis-parallel tree partitions, weighted training examples, three successive stumps, and a combined boosted ensemble.
What you can do after
Apply it via boosting by training stumps sequentially and increasing attention to prior mistakes.

Read how Ensemble Methods for Machine Learning explains decision stump →

What to know first

Related concepts

Questions about decision stump

What is decision stump?

A decision stump is a decision tree of depth one with a single decision node and prediction leaves.

Which Manning books explain decision stump?

Grokking Machine Learning, Second Edition, Grokking Machine Learning and Ensemble Methods for Machine Learning.

What should I know before learning decision stump?

Manning books that teach decision stump usually introduce accuracy, classifier, decision tree and input first.

What is decision stump a kind of?

Decision stump is a kind of decision tree. A decision tree is a tree-structured model or representation in which successive tests or choices lead through branches to outcomes, predictions, or actions.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.