Underfitting
A modeling failure in which insufficient capacity or training prevents a model from capturing relevant patterns in the data, resulting in poor performance even on training data.
Grokking Machine Learning
A model whose complexity is insufficient to capture the relevant structure of its dataset.
- How it is used
- Frames underfitting as a training problem and guides model selection through testing, validation, and complexity comparison.
- How deep it goes
- Defines insufficient complexity, demonstrates it with polynomial regression, and diagnoses it through training, testing, and validation errors.
- Examples
- Uses an exam analogy, polynomial models of degrees 1, 2, and 10, error comparisons, and a model-selection exercise.
- What you can do after
- Diagnose underfitting by comparing training with testing or validation error and select a more suitable model complexity.
Grokking Machine Learning, Second Edition
Underfitting is a modeling failure in which a model is too simple to capture important patterns in the data.
- How it is used
- Frames underfitting as a practical training failure and motivates testing, validation, model-complexity selection, and regularization.
- How deep it goes
- Defines underfitting, works through polynomial examples, and diagnoses it with training-validation behavior and complexity graphs.
- Examples
- Uses an exam-preparation analogy, a curved polynomial-regression dataset, degree-1 and degree-2 models, and a model-complexity graph.
- What you can do after
- Diagnose/debug with it by comparing training and validation performance and selecting model complexity that avoids underfitting and overfitting.
Read how Grokking Machine Learning, Second Edition explains underfitting →
Machine Learning System Design
A condition in which a model is too simple to capture important relationships between features and the target variable, resulting in poor performance on both training and new data.
- How it is used
- Uses learning-curve analysis to diagnose whether poor performance reflects high bias, insufficient data, or excessive variance.
- How deep it goes
- Defines high bias and contrasts it with overfitting, then provides curve-based remedies without deriving model internals.
- Examples
- Uses training–validation curves and an augmented-reality footwear detector that mistakes pet paws and toys for feet.
- What you can do after
- Diagnose underfitting from converged, high-loss curves and choose greater model complexity instead of collecting more data.
Read how Machine Learning System Design explains underfitting →
Generative AI in Action
Underfitting is a modeling condition in which a model fails to learn enough structure from its training data to perform well on new examples.
- How it is used
- Guides fine-tuning monitoring by identifying when a model has not learned enough task-relevant structure.
- How deep it goes
- Interprets training and validation loss patterns, discusses training duration and data adequacy, and uses no mathematical derivation.
- Examples
- Uses GPT-3.5 Turbo training-loss curves and monitored dataset adjustments as concrete diagnostic examples.
- What you can do after
- Diagnose underfitting with training and validation loss, then evaluate whether more training or dataset changes are warranted.
Grokking AI Algorithms, Second Edition
Underfitting is a condition in which a model is too simple or insufficiently trained to perform well even on its training data.
- How it is used
- Diagnoses whether a machine-learning model has learned too little, memorized training data, or generalized useful patterns.
- How deep it goes
- Defines underfitting through contrasts and an analogy, then stops short of prescribing a specific remedy.
- Examples
- Uses an exam-study analogy, incorrect classifications, training accuracy, unseen-data performance, and a fit-comparison figure.
- What you can do after
- Evaluate model fit by comparing training performance with performance on new, unseen data.
Read how Grokking AI Algorithms, Second Edition explains underfitting →
Deep Learning with R, Third Edition
Underfitting is a modeling condition in which a model is too simple or insufficiently trained to capture patterns needed for good performance.
- How it is used
- Uses underfitting as an early training diagnosis and as a guide for increasing model capacity before refining generalization.
- How deep it goes
- Explains training-loss and validation-loss patterns, then gives capacity-scaling steps without mathematical derivation.
- Examples
- Uses MNIST, logistic regression, training curves, trivial baselines, and progressively larger neural networks as examples.
- What you can do after
- Diagnose underfitting from loss and metric trends, then increase layers, layer size, or training duration to test model capacity.
Read how Deep Learning with R, Third Edition explains underfitting →
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
Underfitting is a modeling failure in which a model is too simple to capture important patterns in the data.
- How it is used
- Uses a simple baseline to reveal weak fit, missed structure, and directions for subsequent model development.
- How deep it goes
- Diagnoses underfitting through cross-validation predictions, metrics, plots, infeasible outputs, and coefficient inspection.
- Examples
- Uses a listing-price regression baseline, flat prediction plot, negative predictions, error metrics, and case-level coefficient contributions.
- What you can do after
- Diagnose/debug with cross-validation predictions, evaluation metrics, plots, prediction ranges, and coefficient contributions.
Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains underfitting →
The AI Pocket Book
A failure mode where a model is too simple to capture the training pattern and performs poorly.
- How it is used
- Distinguishes a model that fails to learn the task from one that memorizes training examples.
- How deep it goes
- Defines underfitting through its contrast with overfitting, but stops short of discussing diagnosis or remedies.
- Examples
- Contrasts performance on training data with performance on new sentences and images.
- What you can do after
- Evaluate whether a model’s learned process is too simple to work on training and unseen data.
Build AI Drug Discovery Pipelines
Underfitting is the condition in which a model is too simple to capture relevant patterns in the data and performs poorly even on training data.
- How it is used
- Uses validation curves to diagnose insufficient model complexity in solubility prediction.
- How deep it goes
- Defines underfitting through high bias and training error, then contrasts it with overfitting across model-complexity settings.
- Examples
- Uses an SVR solubility estimator and polynomial feature degrees as concrete examples of model complexity.
- What you can do after
- Evaluate model complexity with validation curves and select a setting that balances training and test error.
Read how Build AI Drug Discovery Pipelines explains underfitting →
Also covered in
- Demand Forecasting Best Practices
- Ensemble Methods for Machine Learning
- Investing for Programmers
- Math and Architectures of Deep Learning
- Machine Learning Algorithms in Depth
- The Art of AI Product Development
- Deep Learning with Python, Third Edition
- Evolutionary Deep Learning: Genetic algorithms and neural networks
What to know first
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- objective functionAn objective function is a mathematical function that assigns values to candidate solutions or parameter settings, which an optimization procedure seeks to minimize or maximize.
- generationGeneration is the production of an output by a computational model from supplied input or context, often using patterns learned from data.
- inputAn input is information, a value, or an action supplied to a system, program, or computation for processing or to influence its behavior.
Related concepts
- overfittingcontrasts with · Overfitting is a modeling condition in which a model adapts too closely to particular data, including its noise or idiosyncrasies, and consequently generalizes poorly to new data.
- genetic algorithmaddressed by · A genetic algorithm is an evolutionary optimization method that improves a population of candidate solutions through fitness-based selection and variation, often including recombination and mutation.
- bias-variance tradeoffcontrasts with · The bias-variance tradeoff is the balance between systematic error from restrictive model assumptions and error from sensitivity to variation in sampled data.
- learning curvemeasured by · A learning curve is a curve or trend showing how performance or proficiency changes with experience, practice, training progress, or training-data size.
- expressive poweraddresses · Expressive power is the capacity of a model, language, or system to represent or convey a range and complexity of functions, patterns, distinctions, or ideas.
- model complexity graphaddressed by · A model complexity graph is a graph that relates model complexity to predictive performance for diagnosing underfitting and overfitting.
Questions about underfitting
What is underfitting?
A modeling failure in which insufficient capacity or training prevents a model from capturing relevant patterns in the data, resulting in poor performance even on training data.
Which Manning books explain underfitting?
Grokking Machine Learning, Grokking Machine Learning, Second Edition, Machine Learning System Design, Generative AI in Action, Grokking AI Algorithms, Second Edition, Deep Learning with R, Third Edition, Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI, The AI Pocket Book and 1 more.
What should I know before learning underfitting?
Manning books that teach underfitting usually introduce language model, objective function, generation and input first.
What is the difference between underfitting and overfitting?
A modeling failure in which insufficient capacity or training prevents a model from capturing relevant patterns in the data, resulting in poor performance even on training data. Overfitting is a modeling condition in which a model adapts too closely to particular data, including its noise or idiosyncrasies, and consequently generalizes poorly to new data.
What is underfitting also called?
Underfitting is also called underfit.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.








