liveBook · Manning

Linearly separable

As explained in Machine Learning Algorithms in Depth

Linearly separable data is data whose classes can be separated by a linear decision boundary.

Data is linearly separable when a linear decision boundary can classify its classes without error. This assumption enables the perceptron to converge after finitely many iterations. section 5.2

The perceptron treatment connects separability to implementation details:

  • The algorithm starts with zero parameters and updates them whenever a training example is misclassified. section 5.2
  • When the training examples are linearly separable, these updates converge after a finite number of iterations. section 5.2
  • Input order affects the learned parameters, so shuffling the training data can be useful. section 5.2

Perceptron classification

A perceptron implemented from scratch trains on iris feature data and predicts test labels from the sign of its linear decision boundary. section 5.2

How Machine Learning Algorithms in Depth covers it

How deep it goes
Defines the convergence assumption and links it to updates, data order, shuffling, and implementation, without deriving separability geometrically.
Examples
Uses iris feature data, a from-scratch perceptron, and test predictions based on the learned decision boundary.
What you can do after
Apply it via a perceptron to understand when finite mistake-driven convergence is expected.
How it connects
Connects linearly separable data to perceptrons, linear classifiers, decision boundaries, and classification.

Also explained in

Compare how 3 books explain linearly separable →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning Algorithms in Depth. The section links point to the parts of the book it draws on.