liveBook · Manning

Conjugacy

Conjugacy is the property that, for a specified likelihood, updating a prior distribution yields a posterior in the same distribution family as the prior.

How 5 Manning books explain it

Grokking Bayes

A conjugate prior is a prior distribution whose posterior belongs to the same distributional family as the prior for a specified likelihood.

How it is used
Enables exact Bayesian updates for continuous parameters without discretizing possible values.
How deep it goes
Works through a beta–binomial parameter update and a normal–normal application, but defers broader conjugate-prior lookup tables.
Examples
Uses tea-versus-coffee preferences and a house-price regression slope to contrast convenient updates with prior-choice limits.
What you can do after
Apply it via a beta–binomial update to calculate a posterior and assess when conjugacy compromises a prior belief.

Read how Grokking Bayes explains conjugacy →

Timeless Algorithms, The Foundational Ideas

A prior distribution that yields a posterior in the same distribution family when updated with data under a particular likelihood.

How it is used
Makes Bayesian learning practical and repeatable by replacing difficult recalculations with parameter updates that can inform decisions.
How deep it goes
Defines conjugacy, explains its integration advantage, and works through Beta–Binomial updating alongside other common pairs.
Examples
Uses machine defect inspections, Beta–Binomial updating, and applications in A/B testing, clinical trials, and quality control.
What you can do after
Apply conjugate updates to revise a probability estimate as observations arrive and carry the posterior into a later update.

Read how Timeless Algorithms, The Foundational Ideas explains conjugacy →

Machine Learning Algorithms in Depth

A conjugate prior is a prior distribution whose posterior belongs to the same distributional family after updating with data.

How it is used
Simplifies Bayesian updating by keeping the posterior in the prior’s distributional family.
How deep it goes
Works through Beta posterior count updates for coin flips but leaves the Dirichlet–multinomial posterior as an exercise.
Examples
Uses coin-flip counts, Bernoulli naive Bayes, and a Dirichlet–multinomial posterior exercise.
What you can do after
Build it from scratch for coin flips by updating Beta prior counts with observed heads and tails.

Read how Machine Learning Algorithms in Depth explains conjugacy →

Math and Architectures of Deep Learning

A prior distribution chosen so that, after Bayes' rule is applied with a specified likelihood family, the posterior stays in the same distribution family.

How it is used
Uses distribution-family preservation to simplify Bayesian parameter estimation and prediction.
How deep it goes
Derives Gaussian and gamma updates, extends them to multivariate cases, and stops short of general nonconjugate inference.
Examples
Uses Gaussian mean estimation, gamma precision estimation, normal-gamma joint estimation, Wishart multivariate estimation, and PyTorch code.
What you can do after
Apply conjugate updating and compute a gamma posterior for unknown variance with known mean in PyTorch.

Read how Math and Architectures of Deep Learning explains conjugacy →

Causal AI

A conjugate prior is a prior distribution whose posterior distribution has the same mathematical form as the prior when combined with a specified likelihood.

How it is used
Uses Bayesian parameter learning for categorical conditional probabilities as an alternative to maximum-likelihood count proportions.
How deep it goes
Defines prior-posterior form matching and explains Dirichlet-categorical updating through counts and prior parameters, without sampling or variational inference.
Examples
Uses a Dirichlet prior to smooth commute-mode probabilities, including an extreme 100% estimate for self-employed people in small towns who drive.
What you can do after
Apply via pgmpy’s BayesianEstimator with a Dirichlet prior and pseudo_counts=1 to estimate categorical model parameters.

Read how Causal AI explains conjugacy →

What to know first

Related concepts

Questions about conjugacy

What is conjugacy?

Conjugacy is the property that, for a specified likelihood, updating a prior distribution yields a posterior in the same distribution family as the prior.

Which Manning books explain conjugacy?

Grokking Bayes, Timeless Algorithms, The Foundational Ideas, Machine Learning Algorithms in Depth, Math and Architectures of Deep Learning and Causal AI.

What should I know before learning conjugacy?

Manning books that teach conjugacy usually introduce posterior probability, prior probability, Bayesian inference and gamma distribution first.

What kinds of conjugacy are there?

Kinds of conjugacy include Dirichlet distribution.

What is conjugacy a kind of?

Conjugacy is a kind of prior probability. A prior probability or distribution is a probability or probability distribution assigned to an event, hypothesis, or unknown quantity before relevant evidence is incorporated.

What is conjugacy part of?

Conjugacy is part of Bayesian model. A Bayesian model is a probabilistic model that represents unknown quantities with prior distributions and updates them to posterior distributions using observed data and Bayes’ theorem.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.