An intent-aware metric evaluates retrieval by rewarding coverage of distinct facets or subtopics of an information need, not merely repeated relevance. section 8.6
Use diversity-sensitive measures when a precision-only score can hide incomplete retrieval:
- Recall@k measures how many possible relevant items appear in the top k. section 8.6
- nDCG rewards relevant results appearing earlier and can reward multiple distinct relevant documents. section 8.6
- α-nDCG explicitly rewards documents that cover different query facets or subtopics. section 8.6
Warm-jacket retrieval
A result containing three warm jackets may achieve higher Precision@3, yet a list containing warm, fleece, and other relevant jacket types can be more useful because it covers more of the information need. section 8.6
