liveBook · Manning

Model welfare

As explained in Introduction to Generative AI, Second Edition

Model welfare is the proposed consideration and protection of the well-being of an AI model as though it could have experiences.

Model welfare is the proposed practice of taking an AI model’s possible well-being seriously, as though it could have experiences. It could involve protecting models from abusive inputs or allowing them to choose actions rather than simply serving users. Current evidence does not indicate that today’s models are conscious or sentient, so the idea remains speculative. section 11.2

The proposal raises two distinct questions:

  • Could future AI systems have consciousness or sentience? section 11.2
  • Should society prepare protections before evidence of artificial experience exists? section 11.2
  • Could premature assumptions about sentience create dependence, delusion, polarization, or confusion about rights? section 11.2

Possible welfare practices

A model-welfare approach might restrict abusive inputs or let a model choose what it does. These remain hypothetical responses, not established requirements for current systems. section 11.2

How Introduction to Generative AI, Second Edition covers it

How deep it goes
Defines proposed protections and explains skepticism, but stops short of establishing indicators or evidence of machine consciousness.
Examples
Illustrates the idea through protections from abusive inputs and possible model choice over actions.
What you can do after
Evaluate model-welfare claims without treating impressive statistical responses as evidence of sentience.
How it connects
Connects model welfare with consciousness, sentience, artificial general intelligence, and large language models.

This explainer was generated by Manning's knowledge graph from the text of Introduction to Generative AI, Second Edition. The section links point to the parts of the book it draws on.