For target Y and predictor X, mutual information is I(Y;X) = H(Y) − H(Y|X): the uncertainty about Y before observing X minus the uncertainty that remains afterward. In feature selection, predictors with higher mutual information reduce more uncertainty about the target. section 5.3.3
Disease prediction
Blood pressure may reduce uncertainty about a diagnosis, while shoe size is unlikely to change it. Mutual information quantifies this difference between predictors. section 5.3.3
The calculation subtracts conditional entropy from the target's original entropy, yielding 0.12 bits of mutual information. section 5.3.3

