liveBook · Manning

Underfitting

As explained in The AI Pocket Book

A failure mode where a model is too simple to capture the training pattern and performs poorly.

Underfitting happens when a model learns a process that is too simple to capture the pattern. It then performs poorly not only on unseen data, but often on its training data too. section 1.27

A useful contrast

A model that memorizes particular training sentences or images suffers from overfitting. A model that learns an overly simple rule fails to handle those training examples effectively and also struggles with new sentences or images. Neither model has learned a useful general process. section 1.27

The practical distinction is simple: generalization means working beyond the examples seen during training, while underfitting means the learned process is not capable enough to work reliably even on the data used to teach it. section 1.27

How The AI Pocket Book covers it

How deep it goes
Defines underfitting through its contrast with overfitting, but stops short of discussing diagnosis or remedies.
Examples
Contrasts performance on training data with performance on new sentences and images.
What it assumes
Assumes the distinction between training and unseen data while defining generalization, overfitting, and underfitting together.
What you can do after
Evaluate whether a model’s learned process is too simple to work on training and unseen data.
How it connects
Connects underfitting to generalization and overfitting through the difference between learning a process and memorizing examples.

Also explained in

Compare how 7 books explain underfitting →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of The AI Pocket Book. The section links point to the parts of the book it draws on.