Discovery measures whether recommendations introduce items that feel new or unexpected while remaining relevant. It complements relevance and diversity by focusing on useful novelty rather than simple variety. section 9.6.1
Evaluate discovery in a structured recommendation-quality check:
- Provide the user's viewing history and the model's top-five recommendations. section 9.6.1
- Ask for a one- to two-sentence justification and a score from 1 to 5. section 9.6.1
- Calibrate judgments with human- or expert-scored examples, then compare rerun stability, inter-model agreement, or correlation with human ratings. section 9.6.1
