liveBook · Manning

Bias

As explained in Timeless Algorithms, The Foundational Ideas

Bias is a systematic deviation that can consistently distort data, estimates, or predictions.

In a support vector machine (SVM), bias is systematic error caused by a boundary too simple to capture the underlying class structure. A small penalty parameter C can tolerate more slack and preserve a wider margin, increasing the risk of high bias and underfitting. A large C can make the boundary overly responsive to training observations, increasing the risk of high variance and overfitting. These are tendencies, not guarantees; no value of C is universally best. section 8.3.3

Objective= 12||w||2+C∑i=1nξi

The objective shows how C weights slack against the margin term, setting the tradeoff that shapes the boundary. section 8.3.3

How Timeless Algorithms, The Foundational Ideas covers it

How deep it goes
Defines bias and relates it to slack, margin width, underfitting, and C, while treating these effects as tendencies rather than guarantees.
What you can do after
Evaluate candidate C values by weighing the risks of rigid, high-bias boundaries against overly responsive, high-variance boundaries.
How it connects
Connects bias with regularization, variance, underfitting, overfitting, and support vector machines.

Also explained in

Compare how 38 books explain bias →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Timeless Algorithms, The Foundational Ideas. The section links point to the parts of the book it draws on.