liveBook · Manning

Hold-out validation

Hold-out validation is an evaluation procedure that partitions data once into separate subsets for model fitting and assessment.

How 2 Manning books explain it

Deep Learning with R, Third Edition

Hold-out validation is an evaluation procedure that reserves a subset of available data for assessment without using it to fit the model.

How it is used
Evaluates generalization during model development by reserving validation data for performance measurement and decision-making.
How deep it goes
Explains the split, training loop, test separation, leakage risk, and small-data limitation, then points to K-fold alternatives.
Examples
Uses indexed data partitioning, model fitting, validation scoring, final retraining, and test evaluation.
What you can do after
Apply it by splitting data, tuning against validation metrics, retraining after decisions, and reserving the test set for final evaluation.

Read how Deep Learning with R, Third Edition explains hold-out validation →

Deep Learning with Python, Third Edition

An evaluation protocol that splits data once into separate subsets for training, validation, and/or testing.

How it is used
Uses a single data split to estimate validation performance while preserving a separate test set for final generalization measurement.
How deep it goes
Explains the split, training, evaluation, retraining, and small-data caveat, then defers repeated partitioning to K-fold methods.
Examples
Demonstrates shuffled array slicing, model fitting, validation evaluation, and final retraining with combined training and validation data.
What you can do after
Apply hold-out validation by splitting data, fitting a model, checking validation performance, and reserving test data for final evaluation.

Read how Deep Learning with Python, Third Edition explains hold-out validation →

Related concepts

Questions about hold-out validation

What is hold-out validation?

Hold-out validation is an evaluation procedure that partitions data once into separate subsets for model fitting and assessment.

Which Manning books explain hold-out validation?

Deep Learning with R, Third Edition and Deep Learning with Python, Third Edition.

What is the difference between hold-out validation and cross-validation?

Hold-out validation is an evaluation procedure that partitions data once into separate subsets for model fitting and assessment. Cross-validation is a model-evaluation technique that repeatedly partitions available data into training and held-out subsets to estimate performance on unseen data.

What is hold-out validation a kind of?

Hold-out validation is a kind of validation. Validation is the process of checking data, behavior, or results against defined criteria to determine their correctness, acceptability, or suitability for a purpose.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.