liveBook · Manning

Position bias

As explained in Building Reliable AI Systems

A distortion in interaction data caused by users being more likely to engage with results because of their displayed position.

Position bias distorts click-derived training signals: users may click a listing because it appears near the top, not because it is relevant. Debiasing helps embedding models learn semantic relationships rather than reproduce this display effect. section 4.2.6

A misleading click

A user clicks a top-ranked listing despite its weak relevance, making the click an unreliable signal of true preference. section 4.2.6

How Building Reliable AI Systems covers it

How deep it goes
Identifies top-rank click bias and the need for debiasing, but gives no specific correction method.
Examples
Uses clicks on top-ranked listings, regardless of relevance, as the concrete failure case.
What you can do after
Understand why click-derived embedding signals need debiasing to represent true semantic relationships.
How it connects
Connects click data and embedding models to learning semantic relationships.

Also explained in

Compare how 2 books explain position bias →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Building Reliable AI Systems. The section links point to the parts of the book it draws on.