Proposal distribution
A proposal distribution is a probability distribution from which a sampling or inference algorithm generates candidate states or samples.
Machine Learning Algorithms in Depth
A proposal distribution is a conditional or unconditional probability distribution used to generate candidate states for a sampling method.
- How it is used
- Supplies candidate states for Metropolis–Hastings and sample locations for importance-sampling estimates.
- How deep it goes
- Derives the Metropolis–Hastings correction from detailed balance and implements proposal-density evaluation and importance weights.
- Examples
- Uses a Gaussian proposal for a two-dimensional Gaussian mixture and a positive-domain Gaussian proposal for an expectation under a chi-shaped target.
- What you can do after
- Build it from scratch to generate Metropolis–Hastings candidates or weight samples in an importance-sampling estimate.
Read how Machine Learning Algorithms in Depth explains proposal distribution →
Grokking Bayes
A proposal distribution is a probability distribution from which candidate moves or states are generated during an iterative sampling algorithm.
- How it is used
- Guides candidate generation within Metropolis–Hastings so MCMC can explore an unknown posterior.
- How deep it goes
- Defines the proposal, specifies its Normal form, and walks through candidate generation and acceptance without proving convergence guarantees.
- Examples
- Uses a tourist-guide analogy, a Normal random walk, and a Beta(4, 3) posterior implemented with Python sampling code.
- What you can do after
- Apply it via Metropolis–Hastings to generate posterior samples from an unnormalized target density.
Fabulous Adventures in Data Structures and Algorithms
A proposal distribution is a probability distribution that generates a candidate next state conditional on a Markov chain's current state.
- How it is used
- Deploys candidate generation inside Metropolis sampling for distributions whose normalized density is difficult to obtain.
- How deep it goes
- Defines conditional generation, explains acceptance behavior, and demonstrates C# construction, but defers systematic proposal tuning.
- Examples
- Uses current-centered normal proposals for target sampling and posterior estimation of coin fairness after observed flips.
- What you can do after
- Apply it via Metropolis to sample target or posterior distributions from non-normalized weight functions.
Read how Fabulous Adventures in Data Structures and Algorithms explains proposal distribution →
What to know first
- normal distributionA normal distribution is a continuous probability distribution with a symmetric, bell-shaped density determined by its mean and variance.
- probability densityA probability density is a nonnegative function describing the distribution of a continuous random variable, with probabilities over intervals or regions given by integrating the function.
Related concepts
- metropolis-hastings samplingused by · Metropolis-Hastings sampling is a Markov chain Monte Carlo method that proposes candidate states and accepts or rejects them with probabilities chosen to preserve a target distribution.
- importance samplingused by · Importance sampling is a statistical technique that estimates expectations under a target distribution by reweighting samples drawn from another distribution.
- markov chain monte carloused by · Markov chain Monte Carlo is a family of sampling algorithms that uses a Markov chain to generate samples from a target probability distribution.
- guide functionimplemented by · A guide function is a Pyro stochastic function that defines the variational approximating process used for inference.
- simulated annealingused by · Simulated annealing is a stochastic optimization method that gradually reduces the probability of accepting worse solutions to escape local optima.
Questions about proposal distribution
What is proposal distribution?
A proposal distribution is a probability distribution from which a sampling or inference algorithm generates candidate states or samples.
Which Manning books explain proposal distribution?
Machine Learning Algorithms in Depth, Grokking Bayes and Fabulous Adventures in Data Structures and Algorithms.
What should I know before learning proposal distribution?
Manning books that teach proposal distribution usually introduce normal distribution and probability density first.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.


