10 Mitigating impacts: platforms, individuals, and society
This chapter covers
- Platforms’ duty of care toward users
- Reclaiming privacy, agency, and limiting the negative impacts of RecSys
- Implications of treating platforms as infrastructure
- Shifting power back to consumers
At the start of the journey, we emphasized why recommender systems are such an important—yet invisible—part of our online lives. They nudge us to which hotel to stay, what person to date, and, maybe more importantly, the next piece of content on social media. To bring more clarity and nuance to this topic, we showed how they work under the hood, and why direct interventions are not easy. The choices platforms are asked to make are more complicated than they seem on the surface, and they can leave everyone dissatisfied, such as in the case of content moderation. We should demand better from platforms, but we need to acknowledge the tradeoffs, especially at the scale and speed platforms operate.
We then moved to define the concept of algorithmic amplification, which can be used to measure whether a recommender system is working properly. In the process, we discovered that objectively and universally measuring something that fundamentally relies on personal preferences is a path fraught with obstacles.