liveBook · Manning

Intermittent reinforcement

As explained in Hidden Influences

A reinforcement schedule in which a behavior is rewarded only on some occasions rather than after every instance.

Checking email can feel like pulling a slot-machine lever: most checks bring nothing interesting, but a message might. Intermittent reinforcement occurs when a behavior is rewarded only sometimes. Because the reward is uncertain, anticipation can help keep the behavior going. section 8.1.2

The source of uncertainty differs by setting: a slot-machine designer controls the odds, while email depends on when other people send messages. Social media feeds use a similar pattern at larger scale. One gambling experiment found the highest dopamine release for a pathological gambler when reward probability was 50%; this suggests anticipation may matter, but does not establish the same effect for everyone. section 8.1.2

How Hidden Influences covers it

How deep it goes
Defines the schedule and links anticipation to reward probability, stopping short of a detailed biological account.
Examples
Uses slot-machine pulls, checking email, and opening a social media feed as examples.
What you can do after
Understand why unpredictable rewards can encourage repeated checking, while recognizing that reward variability can have different sources.
How it connects
Connects reward anticipation and dopamine to gambling, email checking, and social media feeds.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Hidden Influences. The section links point to the parts of the book it draws on.