liveBook · Manning

Radial basis function kernel

As explained in Timeless Algorithms, The Foundational Ideas

A radial basis function kernel is a kernel function whose similarity decreases with distance between observations according to a radial basis function.

The radial basis function (RBF) kernel lets a support vector machine compare observations by distance, enabling localized nonlinear decision boundaries. section 8.6.2

K(xi, x)=exp⁡(-γ||xi-x||2)

The kernel similarity decreases exponentially with the squared distance between observations; γ controls how quickly it falls. section 8.6.2

The fitted boundary depends on parameters as well as the kernel:

  • A smaller γ spreads each support vector’s influence over a wider region, generally producing a smoother boundary; a larger γ makes that influence more local and can lead to overfitting. section 8.6.3
  • γ interacts with the soft-margin penalty C. Evaluate candidate settings with cross-validation rather than selecting them from training accuracy alone. section 8.6.3

Comparing kernel boundaries

On the same synthetic two-class data, the RBF kernel produces a localized nonlinear boundary, unlike the linear kernel’s straight boundary. section 8.6.2

How Timeless Algorithms, The Foundational Ideas covers it

How deep it goes
Defines RBF similarity mathematically and relates γ and C to boundary flexibility, overfitting, and cross-validation-based selection.
Examples
Compares linear, polynomial, and RBF boundaries on the same synthetic two-class data.
What you can do after
Evaluate candidate RBF settings through cross-validation and interpret how γ and C alter boundary flexibility.
How it connects
Connects support vector machines, support vectors, decision boundaries, soft-margin penalties, and cross-validation.

Also explained in

Compare how 4 books explain radial basis function kernel →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Timeless Algorithms, The Foundational Ideas. The section links point to the parts of the book it draws on.