liveBook · Manning

Chapter 7: Beyond Bayesian inference: Raiffa, Schlaifer, and rational decision-making

What you will learn in chapter 7 of Timeless Algorithms, The Foundational Ideas

The introduction explains how Raiffa and Schlaifer extended Bayesian inference into a framework for choosing actions and deciding whether more information is worth obtaining.

After this chapter you will be able to

What it builds on

Section by section

Introduction

The introduction explains how Raiffa and Schlaifer extended Bayesian inference into a framework for choosing actions and deciding whether more information is worth obtaining.

Key terms: posterior probabilities, utilities, expected utility, additional information, tests, experiments, beliefs, preferences, consequences

7.1 Revisiting Bayes: from diagnosis to decision

The section uses a medical diagnosis to show why choosing an action requires weighing its possible consequences alongside posterior probabilities.

Key terms: actions, states of the world, consequence, utility, posterior probabilities, expected utility

7.1.1 From posterior probability to expected utility

This section shows how posterior probabilities and judgments about consequences are combined through expected utility to choose between treating and not treating a patient.

Key terms: posterior probability, utilities, consequences, expected utility, posterior probabilities, preferred action

7.1.2 Decision trees: visualizing choice under uncertainty

This section shows how a decision tree displays choices, uncertainty, and consequences, then uses rollback to identify the action with the highest expected utility.

Key terms: decision node, chance node, terminal node, branches, utility, rollback, expected utility, root, decision-analysis trees, predictive trees

7.1.3 Understanding the value of information

This section explains how to decide whether additional information is worth acquiring by comparing its effect on expected utility with its cost.

Key terms: expected value of information, expected utility, Expected Value of Perfect Information, EVPI, Expected Value of Sample Information, EVSI, posterior beliefs, decision value, acquisition cost, net value of sample information

7.1.4 Applying the value of information

The section applies Bayesian updating, a treatment threshold, and expected utility to decide whether a second diagnostic test is worth its cost.

Key terms: sensitivity, specificity, false positive, false negative, posterior probability, treatment threshold, expected utility, Expected Value of Sample Information, EVSI, net value of sample information

7.2 The decision framework of Raiffa and Schlaifer

This section introduces Raiffa and Schlaifer’s reusable decision framework by identifying the basic elements of a choice under uncertainty.

Key terms: acts, states, experiments

7.2.1 Acts, states, and experiments

This section defines acts, states, and experiments and shows how they connect prior beliefs, new evidence, and a choice of action.

Key terms: acts, set of acts, states, mutually exclusive, collectively exhaustive, experiments, evidence, expected decision value, decision-analytic cycle, prior beliefs

7.2.2 The expected utility formulation

This section shows how to choose an act under uncertainty by combining the utility of each possible outcome with the posterior probability of its state.

Key terms: act, state, utility, posterior probability, expected utility, preferred act

7.2.3 Terminal versus preposterior analysis

This section distinguishes choosing an act after evidence is known from deciding whether to obtain information before its result is known.

Key terms: terminal analysis, posterior probabilities, expected utility, act, preposterior analysis, posterior beliefs, value of learning

7.3 Opportunity loss, regret, and expected utility

The section reframes a physician’s treatment decision in terms of opportunity loss and explains why minimizing expected loss selects the same act as maximizing expected utility.

Key terms: opportunity losses, utility, act, state, expected opportunity loss, expected regret, expected utility

7.3.1 From utility to opportunity loss

Defines opportunity loss for an act in a given state and shows why minimizing its expected value selects the same act as maximizing expected utility.

Key terms: opportunity loss, utility, optimal act, state of nature, expected opportunity loss, expected utility, probability-weighted average

7.3.2 A simple illustration

A product-launch example shows that maximizing expected utility and minimizing expected opportunity loss select the same action under uncertain demand.

Key terms: acts, states, expected utility, opportunity loss, expected opportunity loss

7.4 Conjugate priors and computable Bayesian learning

The section explains why repeated decisions need practical Bayesian updating and how conjugate priors make that updating reusable.

Key terms: posterior probabilities, expected utility analysis, conjugate priors, likelihood functions, posterior distributions, computable Bayesian learning

7.4.1 From integration to parameter updating

The section explains why posterior normalization can make repeated Bayesian updating difficult and how conjugate priors turn it into parameter updating.

Key terms: prior, likelihood, posterior distribution, normalized, closed-form solution, conjugate priors, distribution family, parameter updating, Beta, Binomial

7.4.2 Beta-Binomial updating

This section uses a machine-defect example to show how a Beta prior and Binomial data produce an exact posterior through simple parameter addition.

Key terms: Beta distribution, prior, pseudocounts, defect rate, Binomial experiment, Binomial likelihood, defect probability, sample proportion, conjugate pair, posterior

7.4.3 Why conjugacy matters

This section explains why conjugate priors make repeated Bayesian updating practical, both historically and in modern systems.

Key terms: conjugate priors, parameter updates, closed-form updates, computable Bayesian learning, posterior, prior, distributional form, sequential Bayesian learning

7.5 The enduring value of a rational decision-making framework

This section explains why Raiffa and Schlaifer’s framework remains useful for making uncertain choices, both in management and beyond it.

Key terms: expected utility, additional information, uncertain choices, incomplete information, expected consequences, learning with acting

7.5.1 Decision analysis as a managerial discipline

This section shows how decision analysis helps organizations judge choices by their reasoning and make staged investment, risk, and strategic decisions under uncertainty.

Key terms: decision quality, expected utility, sensitivity analysis, R&D, staged approach, expected value of the information, gray swan events, fat-tailed distributions, scenario planning, value of waiting

7.5.2 Beyond managerial decision-making

The section shows how Raiffa and Schlaifer’s decision framework extends beyond management to public, scientific, and medical choices.

Key terms: acts, uncertain states, consequences, probabilities, utilities or losses, value-of-information framework, expected improvement, experimentation

7.5.3 From decision analysis to machine learning and AI

The section shows how Raiffa and Schlaifer’s decision logic appears in systems that learn while acting or automate choices under uncertainty, while distinguishing decisions from predictions.

Key terms: prediction, decision-making, utility, opportunity loss, states of the world, multi-armed bandit, exploitation, exploration, value-of-information analysis, inference

7.6 Summary

Where this is used later

Concepts explained in this chapter

← Chapter 6: Dynamic programming: Richard Bellman and recursive optimization Chapter 8: Learning to generalize: Vladimir Vapnik and support vector machines →

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.