Validation evaluates candidate models on held-out data before final testing. It helps choose a model that learns useful patterns rather than memorizing its training examples. section 4.5 section 4.0
Use separate portions of the dataset for separate decisions:
- Train every candidate model with the training set. section 4.5
- Compare candidates or hyperparameter choices with validation performance, such as selecting among polynomial models or regularization values. section 4.11 section 4.5
- Use the testing set only at the end to estimate how well the chosen model performs on unseen data. section 4.5
Choosing a polynomial model
Suppose degree-1, degree-2, and degree-10 polynomial regressions are trained on the same training data. Validation error can identify degree 2 as the best choice, while the untouched testing set provides the final check. Common splits include 60-20-20 or 80-10-10 for training, validation, and testing. section 4.5
The equation shows how validation can select the regularization parameter λ by comparing models that balance regression error and simplicity. section 4.11











































