A support vector machine (SVM) is a shallow classifier that selects a sharp, maximum-margin decision boundary in a fixed feature space. That space may be explicit or kernel-defined. section 2.0 section 3.8
SVMs gained popularity in the 1990s and 2000s partly because convex optimization offered an appealing guarantee: a globally optimal solution could be found efficiently. section 2.0
In computer vision pipelines, SVMs classified engineered image features rather than learning hierarchical representations. Systems built features from descriptors such as SIFT, then used shallow learners such as SVMs to map those inputs to outputs. section 2.1
An SVM has no depth to increase: extra computation can solve its optimization more precisely, but does not create the deep-learning scaling loop associated with learning layered representations. section 3.8




