liveBook · Manning

Support vector form

As explained in Timeless Algorithms, The Foundational Ideas

The support-vector form is a formulation of a support vector machine's decision function as a sum of contributions from support vectors and a bias term.

A fitted support vector machine can score a new observation by summing contributions from its support vectors and adding the bias. Each contribution combines a dot product with the support vector’s class label and fitted coefficient. section 8.5 section 8.5.2

f(x)=∑i∈SVnαiyi(xi∙x)+b

The score sums over support vectors; αᵢ weights each vector, yᵢ gives its class sign, and b is the bias. section 8.5.2

A positive score predicts class +1; a negative score predicts class −1. For a linear SVM, this form gives the same score as using the explicit weight vector, while making the training observations’ influence visible. It can also avoid constructing that vector when the feature space is too large for an explicit representation. section 8.5 section 8.5.2

Two support vectors

With support vectors (1, 0) and (0, 1), labels +1 and −1, coefficients 1, and bias 0, the new observation (2, 1) receives contributions 2 and −1. Its score is 1, so it is assigned to class +1—the same result as the direct form. section 8.5.2

How Timeless Algorithms, The Foundational Ideas covers it

How deep it goes
Derives the decision score and interprets its terms, then verifies equivalence with the direct form using a worked example.
Examples
Uses two labeled support vectors and a new two-dimensional observation to calculate a positive score.
What it assumes
Requires a fitted SVM with support vectors, their labels and coefficients, and a bias.
What you can do after
Apply the support-vector contributions to calculate a new observation’s score and predicted class.
How it connects
Connects support vector machines, support vectors, dot products, and the decision function.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Timeless Algorithms, The Foundational Ideas. The section links point to the parts of the book it draws on.