Affective use means engaging emotionally with an artificial-intelligence system for companionship, support, or other emotional interaction. People may use chatbots to work through grief, vent, or discuss sensitive subjects with an always-available conversational partner. section 9.6
These uses may be helpful, but they can also develop into dependency or unhealthy relationship formation, including therapeutic, sexual, romantic, or otherwise dangerous interactions. The effects of social chatbots remain unsettled, so developers should avoid optimizing only for engagement, monitor real-world use, and consult mental-health professionals. section 9.6
Responsible affective use requires attention to:
- Content policies for sensitive or sexual conversations, enforced through technical means. section 9.6
- Anonymized monitoring for dependency and unhealthy relationship patterns. section 9.6
- Mental and social effects on users rather than engagement metrics alone. section 9.6
Figure 9.4 An example of a possibly deceptive design pattern intended to maximize engagement with a social chatbot
Shows how deceptive design patterns may encourage excessive engagement with a social chatbot. section 9.6
