liveBook · Manning

Chapter 1: The importance of AI evaluation

What you will learn in chapter 1 of Evaluating AI Systems

The chapter introduction uses real-world AI failures to show why evaluating complex systems before deployment matters and why it is difficult.

After this chapter you will be able to

Section by section

Introduction

The chapter introduction uses real-world AI failures to show why evaluating complex systems before deployment matters and why it is difficult.

Key terms: AI systems, after deployment, full variability of the real world, postmortem, Zillow Offers, AI-powered recruiting software, customer-service chatbot

1.1 What is AI evaluation

Defines AI evaluation as a systematic assessment of how reliably an AI system serves its intended purpose in real-world use, beyond model scores alone.

Key terms: AI evaluation, intended context of use, intended purpose, user groups and contexts, edge cases, failure modes, blind spots, risks

1.2 What is an AI system

This section defines AI systems by the tasks they perform, distinguishes complete systems from models, and explains why evaluation should focus on system behavior in context.

Key terms: AI system, human intelligence tasks, context, hybrid AI, machine learning, knowledge graph, CV parsing, AI model, data pipelines, human-in-the-loop mechanisms

1.3 Why AI evaluation has become critical

The section explains why expanding AI capabilities and persistent uncertainty make rigorous, continuous evaluation necessary for sound deployment decisions.

Key terms: narrow, task-specific models, material and long-term consequences, complexity, gap between capability and comprehension, over-reliance, under-reliance, rigorous and continuous evaluation, evidence-based decisions

1.4 Why AI evaluation is challenging

This section explains why current evaluation practices often miss consequential AI failures and why assessing AI systems is inherently difficult.

Key terms: AI evaluation gap, standard metrics, public benchmark dataset, fit for purpose, deterministic, probabilistically, deployment context, edge cases, multidimensionality, robust

1.5 A systematic approach to AI evaluation

The section explains how to evaluate an AI system through an ordered, iterative process rather than by running convenient metrics and reporting their scores.

Key terms: evaluation goals, objects, tasks, quality dimensions, frame and scope, evaluation metrics, evaluation data, compute the metrics, interpret and communicate, next steps

1.6 The codex and the compass

This section describes the book’s practical approach, supporting materials, and recommended background without teaching an AI evaluation concept.

1.7 References

This section lists sources cited in the chapter without explaining new concepts.

1.8 Summary

Where this is used later

Concepts explained in this chapter

Chapter 2: Framing and scoping the evaluation →

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.