Decision boundary
A decision boundary is the locus in input or feature space that separates regions assigned different classes or decision outcomes by a predictive model.
Math and Architectures of Deep Learning
A decision boundary that is a straight line or hyperplane, unable to separate the XOR points in this example.
- How it is used
- Frames classification as separating labeled input regions with a learned surface.
- How deep it goes
- Defines geometric and sign-based classification, then contrasts linear approximations with nonlinear boundaries and XOR limitations.
- Examples
- Uses car-versus-giraffe and horse-versus-zebra clusters, a 2D line, a cat threat model, and logical XOR.
- What you can do after
- Evaluate/understand whether a boundary separates classes and why a linear classifier can misclassify nonlinear patterns.
Read how Math and Architectures of Deep Learning explains decision boundary →
Machine Learning Algorithms in Depth
A decision boundary is a surface in feature space that separates regions assigned to different predicted classes.
- How it is used
- Defines where a binary classifier changes its predicted label and provides a geometric criterion for choosing among separating classifiers.
- How deep it goes
- Derives the linear hyperplane interpretation, then formulates boundary selection through point-to-boundary distance and maximum-margin optimization.
- Examples
- Uses a two-dimensional linear-classifier diagram, an iris perceptron, and a maximum-margin support vector machine diagram.
- What you can do after
- Build it from scratch with a perceptron, or evaluate/understand why a support vector machine favors a maximum-margin boundary.
Read how Machine Learning Algorithms in Depth explains decision boundary →
Machine Learning System Design
A decision boundary is the boundary in an input space that separates regions assigned different model decisions or predicted classes.
- How it is used
- Uses threshold-sensitive metrics and perturbation tests to assess whether model decisions remain reliable.
- How deep it goes
- Explains robustness through metric distributions, Poisson bootstrap, noise addition, and confidence bounds without deriving boundary geometry.
- Examples
- Uses precision and recall distributions from bootstrapped datasets with and without added noise.
- What you can do after
- Diagnose boundary fragility by comparing metric shifts and applying robust confidence-bound estimates.
Read how Machine Learning System Design explains decision boundary →
Outlier Detection in Python
A decision boundary is a surface in feature space that separates regions assigned different model decisions or classes.
- How it is used
- Uses a learned surface to test subsequent observations for normality or novelty in one-class outlier detection.
- How deep it goes
- Explains the compactness trade-off and visualizes boundary distance, but stops short of deriving the SVM internals.
- Examples
- Uses two synthetic Gaussian clusters, plotted contours, normal test points, and generated outliers.
- What you can do after
- Diagnose subsequent observations by checking whether they fall within an OCSVM decision boundary.
Read how Outlier Detection in Python explains decision boundary →
Related concepts
- hyperplaneincludes · A hyperplane is a flat affine subspace with dimension one less than its ambient space, capable of dividing that space into regions.
- support vectorused by · A support vector is a training example that contributes to determining a support vector machine’s learned prediction function or decision boundary.
- linear discriminant analysisproduced by · Linear discriminant analysis is a supervised method that projects data to separate labeled classes and supports linear classification.
- classifierequivalent to · A classifier is a predictive computational model that assigns inputs to one or more discrete classes or categories.
- discriminative modelused by · A discriminative model predicts labels or other outcomes from inputs by modeling conditional relationships or decision boundaries rather than the full data-generating distribution.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.