liveBook · Manning

Proposal distribution

A proposal distribution is a probability distribution from which a sampling or inference algorithm generates candidate states or samples.

How 3 Manning books explain it

Machine Learning Algorithms in Depth

A proposal distribution is a conditional or unconditional probability distribution used to generate candidate states for a sampling method.

How it is used
Supplies candidate states for Metropolis–Hastings and sample locations for importance-sampling estimates.
How deep it goes
Derives the Metropolis–Hastings correction from detailed balance and implements proposal-density evaluation and importance weights.
Examples
Uses a Gaussian proposal for a two-dimensional Gaussian mixture and a positive-domain Gaussian proposal for an expectation under a chi-shaped target.
What you can do after
Build it from scratch to generate Metropolis–Hastings candidates or weight samples in an importance-sampling estimate.

Read how Machine Learning Algorithms in Depth explains proposal distribution →

Grokking Bayes

A proposal distribution is a probability distribution from which candidate moves or states are generated during an iterative sampling algorithm.

How it is used
Guides candidate generation within Metropolis–Hastings so MCMC can explore an unknown posterior.
How deep it goes
Defines the proposal, specifies its Normal form, and walks through candidate generation and acceptance without proving convergence guarantees.
Examples
Uses a tourist-guide analogy, a Normal random walk, and a Beta(4, 3) posterior implemented with Python sampling code.
What you can do after
Apply it via Metropolis–Hastings to generate posterior samples from an unnormalized target density.

Read how Grokking Bayes explains proposal distribution →

Fabulous Adventures in Data Structures and Algorithms

A proposal distribution is a probability distribution that generates a candidate next state conditional on a Markov chain's current state.

How it is used
Deploys candidate generation inside Metropolis sampling for distributions whose normalized density is difficult to obtain.
How deep it goes
Defines conditional generation, explains acceptance behavior, and demonstrates C# construction, but defers systematic proposal tuning.
Examples
Uses current-centered normal proposals for target sampling and posterior estimation of coin fairness after observed flips.
What you can do after
Apply it via Metropolis to sample target or posterior distributions from non-normalized weight functions.

Read how Fabulous Adventures in Data Structures and Algorithms explains proposal distribution →

What to know first

Related concepts

Questions about proposal distribution

What is proposal distribution?

A proposal distribution is a probability distribution from which a sampling or inference algorithm generates candidate states or samples.

Which Manning books explain proposal distribution?

Machine Learning Algorithms in Depth, Grokking Bayes and Fabulous Adventures in Data Structures and Algorithms.

What should I know before learning proposal distribution?

Manning books that teach proposal distribution usually introduce normal distribution and probability density first.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.