A post can attract a lot of attention without being useful to the people who see it. Yet a platform may count that attention as evidence of value. This is a proxy metric: a measurable quantity used to represent something that is harder to observe directly. section 4.3
Recommender systems may use signals such as dwell time and engagement to estimate the value of content. These actions are logged and easy to measure, but they do not necessarily reveal what users prefer. The question of how well a measurable indicator represents an abstract idea is called construct validity. section 4.3 section 4.2
The gap between a proxy and its target can appear in everyday behavior:
- An outrageous post may generate replies from people correcting or insulting it. Those interactions can be recorded as engagement and promote the post, even if readers find it unhelpful. section 4.3
- A click on a headline may reveal curiosity rather than satisfaction with the content. Similarly, a purchase may reflect a promotion or necessity rather than a lasting preference. section 4.3
- Wine price can stand in for quality, although taste is personal. People have reported enjoying the same wine more when told it was more expensive. section 4.1
The gap matters even more when a proxy becomes a target. Goodhart’s law captures the risk: people may focus on moving the measure rather than improving the underlying condition. If employees’ goals and rewards depend on engagement, for example, an organization can end up optimizing for attention instead of user value. section 9.2.4
Figure 9.2 How a centralized goal can be divided across various parts of the organization. In this case, the overall goal (North Star Goal) is to increase the active users by 1M. It has been estimated that the company needs to both increase new signups (the domain of the Growth Team) and make sure that fewer existing users drop out (under the purview of the Quality Team), to keep more users active. Members of each team are assigned projects that help with their respective goals. In that way, they have a clear and measurable way of managing their work, and they know they are contributing to achieving the North Star Goal.

See how an active-user goal is divided into team and individual projects. The definition of an active user still shapes what the resulting number means. section 9.2.4
A proxy is useful only insofar as it represents the goal for the purpose at hand. Checking its definition, the behavior it rewards, and the ways it can diverge from the goal helps reveal what the number leaves out. section 4.3 section 9.2.4







