liveBook · Manning

Diversity

As explained in Machine Learning System Design

A measure of how varied the items or categories represented in a set of results are.

A search engine can optimize clicks and purchases yet still show repetitive results. Diversity measures how many different image categories appear on the results page. section 5.3.2

Use diversity as a practical baseline when evaluating search results:

  • Count the different image categories represented on the SERP. section 5.3.2
  • Measure it offline without additional data or recurring collection costs. section 5.3.2
  • Treat the category count as a starting point rather than a complete definition; validate richer notions of variety with UX stakeholders. section 5.3.2

Stock-image search

A PhotoStock results page containing images from eight distinct categories receives a diversity score of eight under the baseline metric, regardless of clicks or purchases. section 5.3.2

How Machine Learning System Design covers it

How deep it goes
Defines a category-count baseline, but defers a fuller definition and alternative approaches to UX research.
Examples
Counts the distinct image categories represented on a PhotoStock search-results page.
What you can do after
Evaluate search-result variety offline by counting represented image categories.
How it connects
Connects diversity with search ranking, click-through rate, conversion rate, human evaluation, and offline metrics.

Also explained in

Compare how 7 books explain diversity →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning System Design. The section links point to the parts of the book it draws on.