liveBook · Manning

Decision boundary

Also called decision surface, nonlinear boundary

A decision boundary is a boundary in input or feature space separating regions assigned different classes or decision outcomes by a predictive model.

How 7 Manning books explain it

Math and Architectures of Deep Learning

A decision boundary that is a straight line or hyperplane, unable to separate the XOR points in this example.

How it is used
Frames classification as separating labeled input regions with a learned surface.
How deep it goes
Defines geometric and sign-based classification, then contrasts linear approximations with nonlinear boundaries and XOR limitations.
Examples
Uses car-versus-giraffe and horse-versus-zebra clusters, a 2D line, a cat threat model, and logical XOR.
What you can do after
Evaluate/understand whether a boundary separates classes and why a linear classifier can misclassify nonlinear patterns.

Read how Math and Architectures of Deep Learning explains decision boundary →

Machine Learning Algorithms in Depth

A decision boundary is a surface in feature space that separates regions assigned to different predicted classes.

How it is used
Defines where a binary classifier changes its predicted label and provides a geometric criterion for choosing among separating classifiers.
How deep it goes
Derives the linear hyperplane interpretation, then formulates boundary selection through point-to-boundary distance and maximum-margin optimization.
Examples
Uses a two-dimensional linear-classifier diagram, an iris perceptron, and a maximum-margin support vector machine diagram.
What you can do after
Build it from scratch with a perceptron, or evaluate/understand why a support vector machine favors a maximum-margin boundary.

Read how Machine Learning Algorithms in Depth explains decision boundary →

Timeless Algorithms, The Foundational Ideas

A decision boundary is a geometric surface separating regions assigned to different predicted classes.

How it is used
Uses the boundary to explain how support vector machines separate classes and seek reliable predictions on new observations.
How deep it goes
Defines the threshold and hyperplane, then explains margins, support vectors, and soft-margin optimization without resolving uncertainty about future data.
Examples
Uses safe and unsafe temperature readings, then considers noisy or mislabeled observations that can distort a hard-margin separator.
What you can do after
Evaluate how margin width, training observations, and soft-margin penalties shape a classifier’s boundary and its limits.

Read how Timeless Algorithms, The Foundational Ideas explains decision boundary →

Transfer Learning for Natural Language Processing

A function or surface that separates input examples assigned to different classes.

How it is used
Uses a separating function to frame the goal of binary classification and motivate learning input transformations.
How deep it goes
Defines the boundary and its generalization goal, but stops short of explaining how to find or optimize one.
Examples
Uses positive and negative sentence labels and illustrates candidate boundaries as arcs separating different types of points.
What you can do after
Understand how classification seeks a boundary that separates training examples and generalizes to unseen inputs.

Read how Transfer Learning for Natural Language Processing explains decision boundary →

Machine Learning System Design

A decision boundary is the boundary in an input space that separates regions assigned different model decisions or predicted classes.

How it is used
Uses threshold-sensitive metrics and perturbation tests to assess whether model decisions remain reliable.
How deep it goes
Explains robustness through metric distributions, Poisson bootstrap, noise addition, and confidence bounds without deriving boundary geometry.
Examples
Uses precision and recall distributions from bootstrapped datasets with and without added noise.
What you can do after
Diagnose boundary fragility by comparing metric shifts and applying robust confidence-bound estimates.

Read how Machine Learning System Design explains decision boundary →

Outlier Detection in Python

A decision boundary is a surface in feature space that separates regions assigned different model decisions or classes.

How it is used
Uses a learned surface to test subsequent observations for normality or novelty in one-class outlier detection.
How deep it goes
Explains the compactness trade-off and visualizes boundary distance, but stops short of deriving the SVM internals.
Examples
Uses two synthetic Gaussian clusters, plotted contours, normal test points, and generated outliers.
What you can do after
Diagnose subsequent observations by checking whether they fall within an OCSVM decision boundary.

Read how Outlier Detection in Python explains decision boundary →

Build AI Drug Discovery Pipelines

A decision boundary is a surface in feature space separating regions assigned to different predicted classes.

How it is used
Uses probability thresholds to convert binary classification estimates into actionable class predictions.
How deep it goes
Explains threshold selection, curve-based evaluation, and calibration, but does not develop geometric boundary calculations.
Examples
Uses cytochrome P450 inhibition predictions and probability thresholds as the concrete classification setting.
What you can do after
Evaluate threshold choices with PR and ROC curves and diagnose or correct probability miscalibration.

Read how Build AI Drug Discovery Pipelines explains decision boundary →

Also covered in

What to know first

Related concepts

Questions about decision boundary

What is decision boundary?

A decision boundary is a boundary in input or feature space separating regions assigned different classes or decision outcomes by a predictive model.

Which Manning books explain decision boundary?

Math and Architectures of Deep Learning, Machine Learning Algorithms in Depth, Timeless Algorithms, The Foundational Ideas, Transfer Learning for Natural Language Processing, Machine Learning System Design, Outlier Detection in Python and Build AI Drug Discovery Pipelines.

What should I know before learning decision boundary?

Manning books that teach decision boundary usually introduce line, classifier, convex optimization and hyperplane first.

What kinds of decision boundary are there?

Kinds of decision boundary include polygonal decision boundary.

What is decision boundary also called?

Decision boundary is also called decision surface or nonlinear boundary.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.