liveBook · Manning

Chapter 3: Picking evaluation metrics

What you will learn in chapter 3 of Evaluating AI Systems

The introduction explains how metrics turn evaluation goals into evidence and why choosing them requires more than picking a familiar measure.

After this chapter you will be able to

What it builds on

Section by section

Introduction

The introduction explains how metrics turn evaluation goals into evidence and why choosing them requires more than picking a familiar measure.

Key terms: metric, accuracy, task success rate, observable evidence, set of metrics, evaluation goals, successes and failures

3.1 “How do we measure this?”

A medical-chatbot evaluation meeting shows why choosing metrics requires balancing practical measurement with whether the scores reflect the properties that matter.

Key terms: off-the-shelf automatic metrics, human judgments, judgment-based evaluations, off-the-shelf metrics, assumptions, properties we care about

3.2 What is a metric

This section defines an AI evaluation metric, explains its four elements, and distinguishes major metric categories and their limitations.

Key terms: metric, task, dimension, input, computation method, output, interpretation, precision, faithfulness, DeepEval

3.3 What makes a good evaluation metric

This section introduces the distinction between a measurable metric and one that gives meaningful, reliable insight into AI system performance.

Key terms: metric, meaningful or reliable insights, effective metrics

3.3.1 Construct validity

This section explains construct validity, why misleading proxies are risky, and how to check whether a metric measures the quality it is meant to assess.

Key terms: construct validity, construct, proxy, prior experience, human or domain judgments

3.3.2 Causal proximity

The section explains how to judge whether a metric changes for meaningful reasons, how to test that connection, and how feedback from a system’s actions can distort it.

Key terms: causal proximity, construct validity, feedback loop, precision, data noise, annotation issues, controlled changes, irrelevant variations, feedback effect, customer churn

3.3.3 Movability

This section explains metric movability—whether a metric can still register meaningful improvements—and ways to assess it.

Key terms: movability, headroom, sensitivity, score distribution, saturated, fine-grained ablations, longitudinal trends, metric variants, NDCG, Precision@K

3.3.4 Reliability

This section defines metric reliability, explains why unstable scores are harmful, and gives two ways to assess consistency.

Key terms: reliability, reproducibility, human-judgment metrics, LLM-as-a-judge metrics, rubric, temperature, repeat measurements, inter-rater agreement, Cohen’s kappa, Krippendorff’s alpha

3.3.5 Robustness

This section explains what makes an evaluation metric robust, why robustness matters, and how to test it.

Key terms: robustness, robust metric, fragile metric, perturbation testing, cross-environment validation, bootstrap, resample evaluation data

3.3.6 Correlation with human judgments

This section explains why metric scores should be checked against human judgments, when that alignment can be misleading, and how to assess it.

Key terms: correlation with human judgment, automatic or AI-as-a-judge metrics, human judgments, bias, correlation, paired human evaluations, correlation coefficients, sanity checks, Pearson’s r, Spearman’s ρ

3.3.7 Interpretability and explainability

This section explains why evaluation metrics must be understandable to their users and how to balance intuitive and technical metrics for different purposes.

Key terms: explainability, interpretability, accountability, regulatory compliance, operational or stakeholder-facing evaluations, research and diagnostic work, interpretable, intuitive metrics, specialized, technical metrics

3.3.8 Measurability

This section explains whether a metric can be measured in practice and warns against choosing easy-to-measure metrics that miss what matters.

Key terms: measurability, feasibility, observable inputs, human evaluation, resource-intensive computation, ethical or legal constraints, McNamara Fallacy, poor proxy, body count

3.4 Designing custom metrics

This section explains when existing metrics warrant customization and why abstract evaluation constructs should be broken into observable components.

Key terms: off-the-shelf metrics, granularity, custom metric, domain-specific distinctions, target construct, operationalized, observable components, helpfulness

3.5 Managing and maintaining metrics

This section explains why evaluation metrics need ongoing reassessment and versioning as systems, goals, proxies, and scoring methods change.

Key terms: revalidated, evaluation goals, quality dimensions, proxy breakdown, proxy, underlying construct, lexical overlap, metric drift, judgment guidelines, rubrics

3.6 References

This section lists sources and documentation referenced in the chapter on evaluation metrics.

3.7 Summary

Where this is used later

Concepts explained in this chapter

← Chapter 2: Framing and scoping the evaluation Chapter 4: Acquiring evaluation data →

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.