Conjugacy
Conjugacy is the property that, for a specified likelihood, updating a prior distribution yields a posterior in the same distribution family as the prior.
Grokking Bayes
A conjugate prior is a prior distribution whose posterior belongs to the same distributional family as the prior for a specified likelihood.
- How it is used
- Enables exact Bayesian updates for continuous parameters without discretizing possible values.
- How deep it goes
- Works through a beta–binomial parameter update and a normal–normal application, but defers broader conjugate-prior lookup tables.
- Examples
- Uses tea-versus-coffee preferences and a house-price regression slope to contrast convenient updates with prior-choice limits.
- What you can do after
- Apply it via a beta–binomial update to calculate a posterior and assess when conjugacy compromises a prior belief.
Timeless Algorithms, The Foundational Ideas
A prior distribution that yields a posterior in the same distribution family when updated with data under a particular likelihood.
- How it is used
- Makes Bayesian learning practical and repeatable by replacing difficult recalculations with parameter updates that can inform decisions.
- How deep it goes
- Defines conjugacy, explains its integration advantage, and works through Beta–Binomial updating alongside other common pairs.
- Examples
- Uses machine defect inspections, Beta–Binomial updating, and applications in A/B testing, clinical trials, and quality control.
- What you can do after
- Apply conjugate updates to revise a probability estimate as observations arrive and carry the posterior into a later update.
Read how Timeless Algorithms, The Foundational Ideas explains conjugacy →
Machine Learning Algorithms in Depth
A conjugate prior is a prior distribution whose posterior belongs to the same distributional family after updating with data.
- How it is used
- Simplifies Bayesian updating by keeping the posterior in the prior’s distributional family.
- How deep it goes
- Works through Beta posterior count updates for coin flips but leaves the Dirichlet–multinomial posterior as an exercise.
- Examples
- Uses coin-flip counts, Bernoulli naive Bayes, and a Dirichlet–multinomial posterior exercise.
- What you can do after
- Build it from scratch for coin flips by updating Beta prior counts with observed heads and tails.
Read how Machine Learning Algorithms in Depth explains conjugacy →
Math and Architectures of Deep Learning
A prior distribution chosen so that, after Bayes' rule is applied with a specified likelihood family, the posterior stays in the same distribution family.
- How it is used
- Uses distribution-family preservation to simplify Bayesian parameter estimation and prediction.
- How deep it goes
- Derives Gaussian and gamma updates, extends them to multivariate cases, and stops short of general nonconjugate inference.
- Examples
- Uses Gaussian mean estimation, gamma precision estimation, normal-gamma joint estimation, Wishart multivariate estimation, and PyTorch code.
- What you can do after
- Apply conjugate updating and compute a gamma posterior for unknown variance with known mean in PyTorch.
Read how Math and Architectures of Deep Learning explains conjugacy →
Causal AI
A conjugate prior is a prior distribution whose posterior distribution has the same mathematical form as the prior when combined with a specified likelihood.
- How it is used
- Uses Bayesian parameter learning for categorical conditional probabilities as an alternative to maximum-likelihood count proportions.
- How deep it goes
- Defines prior-posterior form matching and explains Dirichlet-categorical updating through counts and prior parameters, without sampling or variational inference.
- Examples
- Uses a Dirichlet prior to smooth commute-mode probabilities, including an extreme 100% estimate for self-employed people in small towns who drive.
- What you can do after
- Apply via pgmpy’s BayesianEstimator with a Dirichlet prior and pseudo_counts=1 to estimate categorical model parameters.
What to know first
- posterior probabilityA posterior probability or distribution represents the probability of an event, hypothesis, or unknown quantity conditional on observed evidence and prior information.
- prior probabilityA prior probability or distribution is a probability or probability distribution assigned to an event, hypothesis, or unknown quantity before relevant evidence is incorporated.
- Bayesian inferenceBayesian inference updates probability distributions over hypotheses or unknown quantities by combining prior information with observed evidence and a likelihood model.
- gamma distributionThe gamma distribution is a continuous probability distribution over positive values, parameterized by shape and scale or rate.
Related concepts
- Dirichlet distributionincludes · The Dirichlet distribution is a continuous probability distribution over vectors of nonnegative components that sum to one, parameterized by positive concentration parameters.
- prior probabilitykind of · A prior probability or distribution is a probability or probability distribution assigned to an event, hypothesis, or unknown quantity before relevant evidence is incorporated.
- posterior probabilityproduces · A posterior probability or distribution represents the probability of an event, hypothesis, or unknown quantity conditional on observed evidence and prior information.
- Bayesian inferenceuses · Bayesian inference updates probability distributions over hypotheses or unknown quantities by combining prior information with observed evidence and a likelihood model.
- Bayesian modelpart of · A Bayesian model is a probabilistic model that represents unknown quantities with prior distributions and updates them to posterior distributions using observed data and Bayes’ theorem.
- closed formproduces · A closed-form expression is an exact finite formula built from standard mathematical operations and functions that gives a result directly rather than through iterative numerical approximation.
Questions about conjugacy
What is conjugacy?
Conjugacy is the property that, for a specified likelihood, updating a prior distribution yields a posterior in the same distribution family as the prior.
Which Manning books explain conjugacy?
Grokking Bayes, Timeless Algorithms, The Foundational Ideas, Machine Learning Algorithms in Depth, Math and Architectures of Deep Learning and Causal AI.
What should I know before learning conjugacy?
Manning books that teach conjugacy usually introduce posterior probability, prior probability, Bayesian inference and gamma distribution first.
What kinds of conjugacy are there?
Kinds of conjugacy include Dirichlet distribution.
What is conjugacy a kind of?
Conjugacy is a kind of prior probability. A prior probability or distribution is a probability or probability distribution assigned to an event, hypothesis, or unknown quantity before relevant evidence is incorporated.
What is conjugacy part of?
Conjugacy is part of Bayesian model. A Bayesian model is a probabilistic model that represents unknown quantities with prior distributions and updates them to posterior distributions using observed data and Bayes’ theorem.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.




