Support vector machine
A support vector machine is a supervised-learning model that uses support vectors to define a maximum-margin decision boundary or regression function, with kernels enabling nonlinear relationships.
Timeless Algorithms, The Foundational Ideas
A support vector machine is a supervised learning model that finds a class-separating boundary, typically by maximizing the margin.
- How it is used
- Uses maximum-margin classification to make generalization a design objective rather than relying on training fit alone.
- How deep it goes
- Develops margin geometry, soft-margin capacity control, decision functions, and kernels, connecting them to statistical learning theory.
- Examples
- Uses synthetic safe and unsafe temperature readings to locate a maximum-margin threshold and its support vectors.
- What you can do after
- Evaluate and understand how margin, violations, and kernel flexibility affect classification and generalization.
Read how Timeless Algorithms, The Foundational Ideas explains support vector machine →
Grokking Machine Learning
A model that separates classes or fits targets using an optimized margin and support vectors.
- How it is used
- Uses margin-based classification to choose robust linear boundaries and extend classification to nonlinear datasets through kernels.
- How deep it goes
- Explains geometry, error terms, C, Scikit-Learn coding, and kernels, while stopping short of a full optimization derivation.
- Examples
- Uses competing separating lines, parallel margin diagrams, linear.csv, C comparisons, and the XOR dataset.
- What you can do after
- Apply SVMs via Scikit-Learn, tune C, compare margins, and select kernels for nonlinear classification.
Read how Grokking Machine Learning explains support vector machine →
Sutskever's List
A support vector machine is a supervised learning model that determines decision boundaries using maximum-margin principles.
- How it is used
- Classifies engineered visual features as a shallow alternative to systems that learn hierarchical representations.
- How deep it goes
- Defines sharp boundaries and maximum margins, and notes convex optimization, but does not derive the optimization procedure.
- Examples
- Uses SVMs as classifiers for engineered image features, including pipelines built from SIFT descriptors.
- What you can do after
- Evaluate SVMs as fixed-feature classifiers and contrast their scaling limits with deep learning.
Machine Learning Algorithms in Depth
A supervised learning model that separates classes by selecting a decision boundary with a large margin, optionally using a kernel for nonlinear separation.
- How it is used
- Uses maximum-margin optimization to classify discrete outputs in supervised learning.
- How deep it goes
- Derives primal and dual optimization, kernels, geometry, and implementation details, but does not document a complete application workflow.
- Examples
- Uses margin-boundary geometry, an RBF kernel implementation, pseudo-code, and an Iris classification listing.
- What you can do after
- Builds an SVM from scratch with configurable kernels and trains it through the described optimization.
Read how Machine Learning Algorithms in Depth explains support vector machine →
Data-Driven Cybersecurity
A support vector machine is a supervised-learning model that separates classes or predicts values by constructing a boundary based on support vectors.
- How it is used
- Deploys supervised classification to separate benign activity from phishing, malware, or suspicious network behavior.
- How deep it goes
- Explains boundary-based classification and demonstrates training and evaluation, but does not detail optimization or support-vector internals.
- Examples
- Uses scam emails, malicious network traffic, login activity, and a Python classification report as teaching examples.
- What you can do after
- Apply SVM through Python to classify labeled network or login activity and compare its reported performance with another model.
Read how Data-Driven Cybersecurity explains support vector machine →
Transfer Learning for Natural Language Processing
A supervised learning method that determines a separating boundary by maximizing its margin from the closest training points.
- How it is used
- Classifies data by finding a separating boundary, with email spam and IMDB classification as practical NLP tasks.
- How deep it goes
- Explains hyperplanes, maximum-margin separation, and the kernel trick, then demonstrates linear-kernel training and evaluation.
- Examples
- Tests email spam and IMDB classification, reporting accuracy and training time for each.
- What you can do after
- Apply via scikit-learn's SVC to train a linear classifier, predict test labels, and measure accuracy.
Read how Transfer Learning for Natural Language Processing explains support vector machine →
Ensemble Methods for Machine Learning
A support vector machine is a supervised learning model that finds a maximum-margin separating function, optionally using kernels to represent nonlinear decision boundaries.
- How it is used
- Provides an off-the-shelf baseline for supervised classification and regression while exposing a fit-versus-complexity tradeoff.
- How deep it goes
- Explains kernels, support vectors, C, validation, and overfitting, but stops short of optimization internals.
- Examples
- Uses synthetic supervised regression, Friedman-1 data, RBF-kernel SVR code, validation curves, and complexity figures.
- What you can do after
- Apply it via scikit-learn, choose kernels, tune C, and diagnose overfitting through training and test scores.
Read how Ensemble Methods for Machine Learning explains support vector machine →
Also covered in
- AI-Powered Search
- Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI
- Privacy-Preserving Machine Learning
What to know first
- accuracyAccuracy is the degree to which a result agrees with a specified truth, reference, or criterion, commonly measured as the proportion of evaluated predictions that are correct.
- convex optimizationConvex optimization is the minimization or maximization of a convex or concave objective over a convex feasible set, a structure that permits global optimality guarantees.
- hyperplaneA hyperplane is a flat affine subspace whose dimension is one less than that of its ambient space and that can divide the space into regions.
- decision boundaryA decision boundary is a boundary in input or feature space separating regions assigned different classes or decision outcomes by a predictive model.
Related concepts
- kernel methodkind of · A kernel method is a machine-learning technique that uses a kernel function to model relationships between data points, often without explicitly constructing their feature representations.
- logistic regressioncontrasts with · Logistic regression is a statistical classification model that estimates class probabilities by applying a logistic or softmax function to a linear combination of input features.
- soft-margin extensionincludes · A soft-margin extension is a classification formulation that permits some violations of margin constraints while penalizing those violations.
- kernel functionuses · A kernel function is a mathematical function that measures similarity between inputs, often by representing an inner product in an implicit feature space.
- anomaly detectionuses · Anomaly detection is the identification of observations, events, or behaviors that substantially deviate from expected patterns or a normal baseline.
- neural networkcontrasts with · A neural network is a computational model composed of interconnected, parameterized units or transformations that learn to map inputs to outputs.
Questions about support vector machine
What is support vector machine?
A support vector machine is a supervised-learning model that uses support vectors to define a maximum-margin decision boundary or regression function, with kernels enabling nonlinear relationships.
Which Manning books explain support vector machine?
Timeless Algorithms, The Foundational Ideas, Grokking Machine Learning, Sutskever's List, Machine Learning Algorithms in Depth, Data-Driven Cybersecurity, Transfer Learning for Natural Language Processing and Ensemble Methods for Machine Learning.
What should I know before learning support vector machine?
Manning books that teach support vector machine usually introduce accuracy, convex optimization, hyperplane and decision boundary first.
What is the difference between support vector machine and logistic regression?
A support vector machine is a supervised-learning model that uses support vectors to define a maximum-margin decision boundary or regression function, with kernels enabling nonlinear relationships. Logistic regression is a statistical classification model that estimates class probabilities by applying a logistic or softmax function to a linear combination of input features.
What kinds of support vector machine are there?
Kinds of support vector machine include soft-margin extension.
What is support vector machine a kind of?
Support vector machine is a kind of kernel method. A kernel method is a machine-learning technique that uses a kernel function to model relationships between data points, often without explicitly constructing their feature representations.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.






