liveBook · Manning

Support vector machine

As explained in Sutskever's List

A support vector machine is a supervised learning model that determines decision boundaries using maximum-margin principles.

A support vector machine (SVM) is a shallow classifier that selects a sharp, maximum-margin decision boundary in a fixed feature space. That space may be explicit or kernel-defined. section 2.0 section 3.8

SVMs gained popularity in the 1990s and 2000s partly because convex optimization offered an appealing guarantee: a globally optimal solution could be found efficiently. section 2.0

In computer vision pipelines, SVMs classified engineered image features rather than learning hierarchical representations. Systems built features from descriptors such as SIFT, then used shallow learners such as SVMs to map those inputs to outputs. section 2.1

An SVM has no depth to increase: extra computation can solve its optimization more precisely, but does not create the deep-learning scaling loop associated with learning layered representations. section 3.8

How Sutskever's List covers it

How deep it goes
Defines sharp boundaries and maximum margins, and notes convex optimization, but does not derive the optimization procedure.
Examples
Uses SVMs as classifiers for engineered image features, including pipelines built from SIFT descriptors.
What you can do after
Evaluate SVMs as fixed-feature classifiers and contrast their scaling limits with deep learning.
How it connects
Connects SVMs to convex optimization, kernel methods, handcrafted features, and deep neural networks.

Also explained in

Compare how 5 books explain support vector machine →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Sutskever's List. The section links point to the parts of the book it draws on.