Calibration measures whether predicted probabilities match observed outcome frequencies. If a classifier assigns many cases a probability near 0.80, it is well calibrated when about 80% of those cases are correct: P(correct | predicted probability ≈ 0.80) ≈ 0.80. section 11.6.4
A probability is not a guarantee about an individual prediction. Calibration matters when probabilities guide thresholds, resource allocation, risk assessments, or operational actions. Similar classification accuracy does not ensure similar probability reliability; standard neural-network probabilities also do not automatically capture uncertainty across plausible parameter values. section 11.6.4
Checking an 0.80 prediction
If a model repeatedly assigns cases probabilities near 0.80 but is correct for only 60% of them, its probabilities are poorly calibrated. section 11.6.4
An SVM produces a decision score rather than a probability unless an additional calibration step is applied. section 8.8.2






