Gaussian process
A Gaussian process is a probability distribution over functions in which every finite collection of function values has a joint Gaussian distribution.
Bayesian Optimization in Action
A Gaussian process is a probabilistic model over functions that defines predictive distributions, including means and uncertainties, at unobserved inputs.
- How it is used
- Models expensive black-box objectives as BayesOpt surrogate models that inform which input to evaluate next.
- How deep it goes
- Defines GPs through finite multivariate-normal subsets, explains prior-to-posterior behavior, and implements exact models; later scaling issues are identified.
- Examples
- Uses housing-price regions, prior and posterior function plots, and one-dimensional black-box optimization iterations.
- What you can do after
- Build exact GPyTorch GP models, visualize predictive distributions, train them with gradient descent, and use them within BayesOpt.
Read how Bayesian Optimization in Action explains Gaussian process →
AI-Powered Search
A Gaussian process is a collection of random variables whose finite subsets have joint Gaussian distributions and that defines a probability distribution over functions.
- How it is used
- Balances exploitation of known ranking behavior with exploration of underobserved query–document combinations.
- How deep it goes
- Explains probabilistic prediction, uncertainty, expected improvement, and implementation, but stops short of deriving Gaussian-process mathematics.
- Examples
- Uses river-depth observations, feature combinations, and the “transformers dvd” product-selection example.
- What you can do after
- Apply it via scikit-learn to rank search candidates by expected improvement and select products for exploration.
Machine Learning Algorithms in Depth
A Gaussian process is a collection of random variables such that every finite subset has a jointly Gaussian distribution, defining a probability distribution over functions.
- How it is used
- Models a distribution over functions for continuous-value regression and for performance functions in Bayesian optimization.
- How deep it goes
- Derives noiseless regression predictions by Gaussian conditioning and implements a radial basis function example from scratch.
- Examples
- Uses CO₂ prediction, prior-versus-posterior samples, and hyperparameter searches for support vector machines and random forests.
- What you can do after
- Build it from scratch to compute regression posterior predictions, then evaluate/understand its role in Bayesian optimization.
Read how Machine Learning Algorithms in Depth explains Gaussian process →
Grokking Bayes
A Gaussian process is a probability distribution over functions such that every finite collection of function values has a joint Gaussian distribution.
- How it is used
- Extends Bayesian linear regression when linear relationships are too restrictive.
- How deep it goes
- Interprets Gaussian processes as infinite-degree polynomial models but defers detailed treatment and applications.
- Examples
- Uses linear relationships, higher-degree polynomials, and complex real-world trends as comparison points.
- What you can do after
- Evaluate/understand Gaussian processes as flexible generalizations of Bayesian linear regression for complex trends.
Also covered in
- Experimentation for Engineers
- Build AI Drug Discovery PipelinesIn early access (MEAP)
What to know first
- posterior probabilityA posterior probability or distribution represents the probability of an event, hypothesis, or unknown quantity conditional on observed evidence and prior information.
- Bayesian linear regressionBayesian linear regression is a linear regression model that represents uncertainty about its parameters and predictions with probability distributions.
- exploitationIn optimization and decision-making, exploitation is selecting an option currently believed, based on available information, to yield high value.
- kernel functionA kernel function is a mathematical function that measures similarity between inputs, often by representing an inner product in an implicit feature space.
Related concepts
- language modelkind of · A language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- covariance functionhas part · A covariance function, also called a kernel, specifies the covariance between function values at pairs of inputs in a Gaussian process.
- mean functionhas part · A mean function maps an input to the expected value of a random function before conditioning on observed data.
- Bayesian optimizationused by · Bayesian optimization is a sequential method for optimizing an expensive or unknown objective by using a probabilistic model to guide evaluations.
- kernel functionuses · A kernel function is a mathematical function that measures similarity between inputs, often by representing an inner product in an implicit feature space.
- radial basis function kerneluses · A radial basis function kernel is a similarity function whose value depends on the distance between inputs and typically decreases as that distance increases.
Questions about Gaussian process
What is Gaussian process?
A Gaussian process is a probability distribution over functions in which every finite collection of function values has a joint Gaussian distribution.
Which Manning books explain Gaussian process?
Bayesian Optimization in Action, AI-Powered Search, Machine Learning Algorithms in Depth and Grokking Bayes.
What should I know before learning Gaussian process?
Manning books that teach Gaussian process usually introduce posterior probability, Bayesian linear regression, exploitation and kernel function first.
What is Gaussian process a kind of?
Gaussian process is a kind of language model. A language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
What are the parts of Gaussian process?
Gaussian process includes covariance function and mean function.
What is Gaussian process also called?
Gaussian process is also called GPs.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.



