liveBook · Manning

Linearly separable

Also called linear separability

Linearly separable describes labeled data whose classes can be divided by a single linear decision boundary in feature space.

How 4 Manning books explain it

Grokking Machine Learning

The property of a labeled dataset whose classes can be separated by a single linear boundary.

How it is used
Frames linear separability as the test that motivates nonlinear classifiers and kernel methods.
How deep it goes
Defines separability geometrically and works through feature transformations, while deferring the full theory of kernels and feature maps.
Examples
Uses circular data, modified XOR, one-dimensional points, polynomial features, and RBF-transformed datasets.
What you can do after
Evaluate whether a dataset needs a nonlinear boundary and understand how feature transformations can make separation possible.

Read how Grokking Machine Learning explains linearly separable →

Machine Learning Algorithms in Depth

Linearly separable data is data whose classes can be separated by a linear decision boundary.

How it is used
Supports perceptron classification by providing the assumption under which mistake-driven parameter updates converge.
How deep it goes
Defines the convergence assumption and links it to updates, data order, shuffling, and implementation, without deriving separability geometrically.
Examples
Uses iris feature data, a from-scratch perceptron, and test predictions based on the learned decision boundary.
What you can do after
Apply it via a perceptron to understand when finite mistake-driven convergence is expected.

Read how Machine Learning Algorithms in Depth explains linearly separable →

Deep Learning with R, Third Edition

Linearly separable data is data whose classes can be divided by a linear decision boundary.

How it is used
Uses separable synthetic data to teach a complete linear classifier trained with gradient descent.
How deep it goes
Works through data generation, prediction, loss, gradients, updates, thresholding, and boundary plotting, without deeper classifier theory.
Examples
Uses two Gaussian point clouds in a two-dimensional plane, binary labels, training-loss output, prediction colors, and a plotted boundary.
What you can do after
Builds a linear classifier from scratch in TensorFlow and visualizes its predictions and learned boundary.

Read how Deep Learning with R, Third Edition explains linearly separable →

Timeless Algorithms, The Foundational Ideas

Linear separation is the property that classes can be divided by a linear decision boundary in a feature space.

How it is used
Defines when a classifier can separate training classes without error, establishing a starting point for support vector machine geometry.
How deep it goes
Defines error-free separation in one dimension and previews hyperplanes, margins, and support vectors before algebraic optimization.
Examples
Uses safe and unsafe manufacturing temperatures on a number line, then extends the synthetic classification example into two dimensions.
What you can do after
Understand when training observations admit an error-free boundary and why maximum-margin SVMs prefer one separator over another.

Read how Timeless Algorithms, The Foundational Ideas explains linearly separable →

What to know first

Related concepts

Questions about linearly separable

What is linearly separable?

Linearly separable describes labeled data whose classes can be divided by a single linear decision boundary in feature space.

Which Manning books explain linearly separable?

Grokking Machine Learning, Machine Learning Algorithms in Depth, Deep Learning with R, Third Edition and Timeless Algorithms, The Foundational Ideas.

What should I know before learning linearly separable?

Manning books that teach linearly separable usually introduce linear regression first.

What is linearly separable also called?

Linearly separable is also called linear separability.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.