Normalized mutual information (NMI) evaluates whether cluster assignments reveal known categories. It measures how much knowing an observation’s cluster reduces uncertainty about its true category, complementing geometric assessments of cluster separation. section 5.3.4
Fruit clusters
If 12 fruits—four apples, four bananas, and four pears—are clustered into three groups, each containing only one fruit category, knowing a fruit’s cluster removes all uncertainty about its category. This illustrates an ideal outcome for NMI. section 5.3.4
