Empirical risk is the average loss a model incurs on the observations in a sample. For ordinary classification accuracy, empirical misclassification risk equals one minus training accuracy. section 8.7.1
For ordinary classification accuracy, this expresses empirical misclassification risk as one minus training accuracy; other loss functions are averaged over the sample. section 8.7.1
Empirical risk minimization (ERM) favors the permitted model with the lowest sample loss. That fit alone does not distinguish equally accurate models with different capacities; generalization depends on fit in relation to capacity and sample size. section 8.7.1 section 8.7.2
