liveBook · Manning

Deployment bias

As explained in Introduction to Generative AI, Second Edition

Deployment bias is systematic disparity that occurs when a deployed AI system serves some populations better than others.

Deployment bias is a systematic disparity that occurs when an artificial intelligence system serves some populations better than others. It is one possible source of bias across the AI pipeline, alongside data collection, labeling, and model development. Bias reflects a mismatch between model outputs and the diverse populations those outputs represent; it can produce different results across attributes such as race, gender, class, age, or religion. section 3.2

A deployment-stage disparity

A system that performs better for one population than another illustrates deployment bias. This differs from labeling bias, which arises when annotators’ assumptions affect the labels used to train a model. section 3.2

How Introduction to Generative AI, Second Edition covers it

How deep it goes
Defines deployment bias and locates it within the AI pipeline without detailing measurement, diagnosis, or mitigation.
Examples
Uses unequal system performance across populations and annotator assumptions as contrasting illustrations of deployment and labeling bias.
What it assumes
Assumes a basic understanding of bias as disparate model outputs across personal identity attributes.
What you can do after
Evaluate whether unequal service across populations may indicate bias arising during system deployment.
How it connects
Connects deployment bias with labeling bias, training data, model outputs, and population representation.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Introduction to Generative AI, Second Edition. The section links point to the parts of the book it draws on.