liveBook · Manning

Automated decision system

As explained in Hidden Influences

A computational system that makes decisions automatically using data, rules, or learned models.

When a social platform handles more content than people can review, automated decision systems can help make moderation decisions. They may identify policy violations without giving users a clear explanation or useful recourse. section 10.1.1

A moderation decision

A system may misunderstand content, leading to its removal or a user’s ban. Unequal enforcement can also make some groups’ speech less visible. section 10.1.1

How Hidden Influences covers it

How deep it goes
Explains policy-violation detection and opaque outcomes, but gives no technical account of system design.
Examples
Shows content removal or bans after misunderstandings, and unequal visibility for some groups.
What you can do after
Evaluate how automated moderation can affect users without providing clear explanations or recourse.
How it connects
Connects content moderation with platform transparency and contestability.

This explainer was generated by Manning's knowledge graph from the text of Hidden Influences. The section links point to the parts of the book it draws on.