liveBook · Manning

Chapter 10: Mitigating impacts: platforms, individuals, and society

What you will learn in chapter 10 of Hidden Influences

The introduction recaps recommender systems’ benefits and risks and argues that mitigating platform harms requires collective as well as individual action.

After this chapter you will be able to

What it builds on

Section by section

Introduction

The introduction recaps recommender systems’ benefits and risks and argues that mitigating platform harms requires collective as well as individual action.

Key terms: collective action, regulatory action, negative externalities, limiting exposure, recommender systems, gatekeepers, harmful and hateful content, algorithmic amplification, personal preferences

10.1 Platforms: power and duty over users

This section explains how platforms shape online discussion and why their power raises questions about responsibility to users and society.

Key terms: incentives, promoted content, duty of care, economic incentives, society’s well-being

10.1.1 Power over users, and lack of contestability

This section examines platforms’ unilateral moderation power, its consequences for users, and the contrast between opaque moderation and procedural justice.

Key terms: content moderation, terms of service, ban, transparency, recourse, automated decision-making systems, content moderator, differential treatment, procedural justice, appeal

10.1.2 The power of incentives

This section explains how platforms’ ranking incentives shape creators and public discourse, and considers alternatives and barriers to adopting them.

Key terms: optimization target, algorithmic incentives, algorithmic tastemakers, engagement optimization, public discourse, misinformation, bridging content, explicit value judgments, behavioral signals, algorithmic feeds

10.1.3 Duty of care

This section examines duty of care for online platforms and the difficulties of governing content choices that shape users’ experiences.

Key terms: duty of care, foreseeable injury or harm, reasonable steps, neutral tools, recommender systems, high-visibility shelves, healthy and unhealthy content, misinformation, COVID-19 pandemic, content amplification

10.2 Taking action as individuals

This section explains the limits and tradeoffs of reducing individual dependence on recommendation platforms.

Key terms: dependency, addictive nature of platforms

10.2.1 Seeing through the lie: meta awareness

This section explains how awareness of platform incentives and product design, alongside support for external accountability, can help individuals respond to platforms’ influence.

Key terms: meta-awareness, incentives, enshittifying, transparency, external accountability, regulation, bottom line, product design, habit, behavior and content is rewarded

10.2.2 Disrupt the disruption

This section presents ways individuals can add friction to platform use and online engagement to resist passive consumption and impulsive responses.

Key terms: friction, time limits, timeout notification, algorithm-based personalization, engagement, reverse-chronological view, autoplay, default choices, passive consumption, confirmation bias

10.2.3 Reclaim privacy

This section explains how individuals can limit personal data sharing, weigh its irreversible costs, and exercise caution about trust online.

Key terms: targeted advertising, third-party sharing, app settings, data sharing, targeted ads, third party, trust, collaboration, scam artists

10.2.4 “On the internet, nobody knows you are a dog”

This section examines the benefits and risks of online anonymity, illustrates coordinated manipulation, and recommends a more critical approach to online information.

Key terms: anonymity, gatekeepers, generative AI, disinformation campaign, confirmation bias, fake profiles, Internet Research Agency, Black Lives Matter, Blue Lives Matter, polarization

10.3 E pluribus unum: collective action to ensure customer protection

This section argues for collective oversight of powerful platforms, while weighing industry objections and risks to free speech.

Key terms: network effect, monopoly, power structure, data flywheel, Generative AI, centralized operators, collective intervention, platforms’ safety and oversight, second-hand smoking, self-governing

10.3.1 Platform portability

This section argues that shared protocols could make social platforms more portable, competitive, and open while changing how moderation works.

Key terms: platform portability, content, contacts, protocol, client, shared and open protocols, enshittifying, competing services, user-facing client, content moderation

10.3.2 Data sharing

This section argues for independent access to platform data and explains the consequential choices involved in auditing political amplification.

Key terms: third-party auditing, transparency, consumer protection, Digital Services Act, vetted researchers, systemic risks, users’ engagement, reach, transparency requirements, moderators

10.4 Summary

Concepts explained in this chapter

← Chapter 9: Understanding platform incentives

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.