liveBook · Manning

Chapter 4: Algorithmic amplification: Measuring RecSys

What you will learn in chapter 4 of Hidden Influences

This introduction explains how recommender systems distribute attention and why assessing their amplification requires difficult judgments about preferences, quality, and fairness.

After this chapter you will be able to

What it builds on

Section by section

Introduction

This introduction explains how recommender systems distribute attention and why assessing their amplification requires difficult judgments about preferences, quality, and fairness.

Key terms: recommender systems, attention, users’ preferences, amplification, quality, fair allocation

4.1 Quantifying amplification

This section introduces the measurement concepts and socio-technical context needed to define algorithmic amplification more concretely.

Key terms: objective quantity, proxy, perceived quality, unit of measure, baseline, relative zero, amplification, socio-technical systems, users, technology

4.2 Implicit learning

This section explains how recommender systems infer preferences from interactions, the limitations of that inference, and the difficulty of communicating preferences directly.

Key terms: implicit learning, interactions, engagement, exploration-versus-exploitation dilemma, discovery, preferences, unobserved preferences, measurable interactions, construct validity, proxy

4.3 Users’ preferences and proxy metrics

This section explains why recommendation value is hard to measure directly and why observable engagement and other behaviors can be imperfect proxies for users’ preferences.

Key terms: accuracy, value, users’ preferences, proxy metrics, engagement signals, dwell time, construct validity, engagement, click-through rates, observed behavior

4.4 Testing recommender systems: A/B tests

This section explains how platforms use historical comparisons and live A/B tests to decide whether to deploy a new recommender model.

Key terms: metrics, retention, engagement, time spent, north star, historical data, past engagement, counterfactual questions, model A, model B

4.5 Lack of a baseline

This section explains why recommender systems need baselines for evaluation and why no neutral, universally accepted baseline exists.

Key terms: baseline, random baseline, reverse chronological order, algorithm, unbiased baseline, amplification, intrinsic value, population level

4.6 Socio-technical nature of technology

This section introduces a socio-technical perspective on recommender systems using the example of mechanization in English mines.

Key terms: socio-technical perspective, recommender systems, mechanization, productivity, economic incentives

4.6.1 Feedback loops

This section explains feedback loops in predictive systems by contrasting unaffected forecasts with a policing example in which decisions shape future measurements and decisions.

Key terms: feedback loop, predictive algorithmic systems, police deployment, reported crime, crime metric, crime reports, arrests, discretionary component

4.6.2 Feedback loops in recommender systems and social media

This section explains the circular feedback between users and recommender systems and why their contributions to recommendations are difficult to separate.

Key terms: feedback loop, recommendations, interactions, contribution of the users, contribution of the algorithms

4.6.3 The rich-getting-richer effect

This section explains how limited exposure and engagement feedback can make popular recommendations increasingly dominant, and notes one way platforms can counter the effect.

Key terms: scores, ranking, exposure, rich-getting-richer effect, positive signal, feedback loop, ranked lower, chance to be seen

4.7 Labeling

This section introduces content labeling as a challenge in comparing the amplification of opposing positions on a policy.

Key terms: labeling, content, relative amplification

4.7.1 Labeling content

This section explains why labeling content as for or against a policy is difficult when measuring relative amplification, even with machine learning.

Key terms: for or against a specific policy issue, relative amplification, machine learning, labels, policy conversation

4.7.2 Labeling users

This section examines the limitations and privacy risks of labeling users to measure algorithmic amplification.

Key terms: labeling users, amplification, stance, amplification calculation, content, following, privacy, political stances, data governance, labeling

4.8 Summary

Where this is used later

Concepts explained in this chapter

← Chapter 3: Content moderation Chapter 5: Redefining amplification →

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.