liveBook · Manning

Polynomial kernel

As explained in Timeless Algorithms, The Foundational Ideas

A polynomial kernel is a kernel function whose value is based on a polynomial of the input observations’ inner product.

A polynomial kernel lets an SVM represent powers and interactions among original features without explicitly constructing them. The SVM fits a linear hyperplane in the resulting feature space; in the original space, that boundary can appear curved. section 8.6.2

K(xi,x)=(xi∙x+c)d

The degree d controls the order of represented powers and interactions; c affects the influence of lower-degree terms. section 8.6.2

A second-degree kernel can represent squared features and pairwise interactions. Higher degrees allow more complex interactions, but can make the model more sensitive to training-data irregularities. Polynomial transformations affect the feature space globally, so boundary changes generally extend across the data rather than staying local. section 8.6.2 section 8.6.3

The degree also interacts with the soft-margin penalty C. Treat degrees and other model settings as candidate configurations, and compare them through cross-validation rather than training accuracy alone. section 8.6.3

How Timeless Algorithms, The Foundational Ideas covers it

How deep it goes
Defines the polynomial form, interprets degree and offset, and links feature-space hyperplanes to curved boundaries in original space.
Examples
Uses a second-degree kernel for squared features and pairwise interactions, and contrasts a third-degree boundary with linear and RBF boundaries.
What you can do after
Evaluate candidate polynomial degrees through cross-validation rather than training accuracy alone.
How it connects
Connects SVMs, feature spaces, soft-margin penalties, and cross-validation.

Also explained in

Compare how 2 books explain polynomial kernel →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Timeless Algorithms, The Foundational Ideas. The section links point to the parts of the book it draws on.