liveBook · Manning

Evaluation dataset

As explained in Grokking Statistics

A held-out dataset used to evaluate a trained model on observations not used for fitting it.

A test set is labeled data held back until after training. It checks whether a model performs well on observations it has never seen, rather than merely repeating its training examples. section 1.5

Test sets support predictive modeling, where performance matters more than inspecting every detail of a model. A strong result on a test set is useful evidence, not a guarantee: a model that performs well in a lab may still fail in the wild, especially when bias affects real decisions. section 1.5

How Grokking Statistics covers it

How deep it goes
Defines the evaluation role but does not detail dataset splitting, metrics, or implementation.
What it assumes
Assumes a trained model and labeled observations, while treating evaluation through predictive performance rather than model explanation.
What you can do after
Evaluate a trained model against labeled observations excluded from its training process.
How it connects
Connects test sets to machine learning, predictive modeling, labeled data, statistical learning, and model bias.

Also explained in

Compare how 27 books explain evaluation dataset →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Grokking Statistics. The section links point to the parts of the book it draws on.