Margin

As explained in Machine Learning System Design

A measure of the separation between observations and the classifier boundary that determines their predicted classes.

A decision-boundary margin describes how robustly a classifier separates observations into predicted classes. A narrow margin means small sample noise can materially change precision and recall. section 7.4

Compare metric distributions with and without normally distributed noise. Large shifts—such as increased recall paired with decreased precision—signal that the boundary is not robust. section 7.4

Testing boundary robustness

Use Poisson bootstrap samples to estimate metric distributions, then add noise as a hyperparameter. Evaluate bootstrapped lower confidence bounds for recall at a chosen precision or specificity. section 7.4

Distribution of precision and recall with sample size of 200;000; every point is a bootstrapped original dataset, no noise added.

Inspect the no-noise bootstrap distribution before comparing it with the corresponding noise-added distribution. section 7.4

How Machine Learning System Design covers it

How deep it goes

Explains threshold sensitivity, noise testing, bootstrap distributions, and confidence bounds without deriving classifier geometry.

Examples

Demonstrates robustness using precision-recall distributions, bootstrapped datasets, sample sizes, and added normally distributed noise.

What you can do after

Diagnose boundary fragility by comparing noisy and unnoised metric distributions and reporting bootstrapped lower confidence bounds.

How it connects

Connects decision boundaries with precision, recall, specificity, thresholds, bootstrap, noise, and confidence intervals.

liveBookmanning.com

Read Machine Learning System Design on liveBook Get the book at manning.com

Also explained in

• 

  liveBookmanning.com
  Machine Learning Algorithms in DepthA margin is the distance between a classifier's decision boundary and the nearest training examples or class-separating boundaries.

Compare how 2 books explain margin →

Related concepts

• support vector machineused by · A support vector machine is a supervised-learning model that uses support vectors to determine a maximum-margin decision boundary or regression function, optionally using kernels to model nonlinear relationships.
• boostingused by · Boosting is an ensemble-learning technique that builds predictive models sequentially and combines them, with later models improving on weaknesses of earlier ones.
• error ratemeasures · Error rate is the proportion of evaluated operations, cases, or outcomes that produce an error or fail a specified criterion.
• support vectorused by · A support vector is a training example that contributes to determining a support vector machine’s learned prediction function or decision boundary.

This explainer was generated by Manning's knowledge graph from the text of Machine Learning System Design. The section links point to the parts of the book it draws on.