Miss rate measures the share of relevant items that a recommendation model fails to surface. It is the inverse of recall@K, but its meaning depends on how relevance and the recommendation list are defined. section 3.2.1
Use miss rate to clarify recommendation failures:
- Compare missed relevant items across user segments rather than relying only on aggregate precision, recall, or NDCG. section 3.2.1
- Define the error explicitly: a miss means a relevant movie was not included in the evaluated recommendation list. section 3.2.1
Preferred-genre comparison
Group users by preferred genre, such as action, drama, comedy, or indie, using watch history or other engagement signals. A substantially higher miss rate for indie-film users indicates weaker coverage for that segment. section 3.2.1
Figure 3.7 represents how the error rate for a specific subgroup is calculated. In this context, the numerator "number of errors for subgroups" could mean false positives, false negatives, or both, depending on what you're analyzing.
Use the subgroup error-rate figure to inspect how missed relevant recommendations fit within a broader error calculation. section 3.2.1
