Kernel method
A kernel method is a machine-learning technique that uses a kernel function to model relationships between data points, often without explicitly constructing their feature representations.
Grokking Machine Learning
A machine-learning technique that maps data into a higher-dimensional feature space so linear methods can model nonlinear relationships.
- How it is used
- Uses higher-dimensional embeddings with SVMs to classify datasets requiring nonlinear boundaries.
- How deep it goes
- Explains geometric transformations, similarity features, RBF gamma, polynomial kernels, and Scikit-Learn examples, while deferring full kernel theory.
- Examples
- Uses circular data, modified XOR data, one-dimensional points, similarity tables, and RBF or polynomial SVM classifiers.
- What you can do after
- Apply it via Scikit-Learn’s SVC with polynomial or RBF kernels and experiment with degree and gamma.
Timeless Algorithms, The Foundational Ideas
A kernel method is a computational technique that uses a kernel function to represent relationships between data points without explicitly constructing their feature representations.
- How it is used
- Lets support vector machines operate in transformed feature spaces without explicitly constructing every additional feature.
- How deep it goes
- Introduces the role of feature transformation but defers kernel mechanics while developing the hard-margin SVM.
- Examples
- Maps temperature to temperature and temperature squared to make safe and unsafe readings linearly separable.
- What you can do after
- Understand how an SVM can use richer feature spaces without explicitly building all added features.
Read how Timeless Algorithms, The Foundational Ideas explains kernel method →
Also covered in
What to know first
- support vector machineA support vector machine is a supervised-learning model that uses support vectors to define a maximum-margin decision boundary or regression function, with kernels enabling nonlinear relationships.
Related concepts
- support vector machineincludes · A support vector machine is a supervised-learning model that uses support vectors to define a maximum-margin decision boundary or regression function, with kernels enabling nonlinear relationships.
- machine learningkind of · Machine learning is a field of computational methods in which systems learn patterns or relationships from data to make predictions, decisions, or other outputs.
- spaceuses · A mathematical space is a set of elements equipped with structure or relationships that provide a context for mathematical analysis.
- polynomial kernelused by · A polynomial kernel is a kernel function that measures similarity between inputs using a polynomial of their inner product.
- radial basis function kernelused by · A radial basis function kernel is a similarity function whose value depends on the distance between inputs and typically decreases as that distance increases.
- nonlinear classifierproduces · A classifier whose decision boundary cannot be represented by a single linear or affine function of the input features.
Questions about kernel method
What is kernel method?
A kernel method is a machine-learning technique that uses a kernel function to model relationships between data points, often without explicitly constructing their feature representations.
Which Manning books explain kernel method?
Grokking Machine Learning and Timeless Algorithms, The Foundational Ideas.
What should I know before learning kernel method?
Manning books that teach kernel method usually introduce support vector machine first.
What kinds of kernel method are there?
Kinds of kernel method include support vector machine.
What is kernel method a kind of?
Kernel method is a kind of machine learning. Machine learning is a field of computational methods in which systems learn patterns or relationships from data to make predictions, decisions, or other outputs.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

