liveBook · Manning

Conditioning

As explained in Bayesian Optimization in Action

Conditioning is the mathematical operation of updating a probability distribution after fixing or observing the value of one or more variables.

Conditioning updates a probability distribution after fixing or observing one or more variables. In a joint multivariate normal distribution, observing one value produces a posterior belief about all related variables. Positive correlation can shift a variable’s mean and reduce its uncertainty; the observed variable becomes fixed. section 2.2.2

Conditioning on B = 4

Suppose A, B, and C represent uncertain prices. Conditioning their joint Gaussian distribution on B = 4 updates A because A and B are positively correlated, while B has no remaining uncertainty. Conditioning on C = 4 leaves other marginal distributions unchanged when C is unrelated to them. section 2.2.2

Bayes’ theorem gives the Gaussian update in closed form, producing exact posterior means and variances. Gaussian processes use the same idea to learn from observations, becoming more confident near observed data and more uncertain farther away. section 2.2.2 section 2.6

How Bayesian Optimization in Action covers it

How deep it goes
Defines the operation and explains posterior behavior through Gaussian examples, but defers the math-heavy derivation.
Examples
Uses correlated price variables, observations B = 4 or C = 4, parallel-coordinate plots, and a knot analogy.
What it assumes
Assumes familiarity with probability distributions and correlation while introducing the conditioning operation through joint Gaussian examples.
What you can do after
Evaluate how observations shift posterior means and reduce uncertainty in Gaussian models.
How it connects
Connects conditioning with Bayesian inference, Bayes’ theorem, multivariate normal distributions, posterior distributions, and Gaussian processes.

Also explained in

Compare how 2 books explain conditioning →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Bayesian Optimization in Action. The section links point to the parts of the book it draws on.