liveBook · Manning

Gaussian process

Also called GPs

A Gaussian process is a probability distribution over functions in which every finite collection of function values has a joint Gaussian distribution.

How 4 Manning books explain it

Bayesian Optimization in Action

A Gaussian process is a probabilistic model over functions that defines predictive distributions, including means and uncertainties, at unobserved inputs.

How it is used
Models expensive black-box objectives as BayesOpt surrogate models that inform which input to evaluate next.
How deep it goes
Defines GPs through finite multivariate-normal subsets, explains prior-to-posterior behavior, and implements exact models; later scaling issues are identified.
Examples
Uses housing-price regions, prior and posterior function plots, and one-dimensional black-box optimization iterations.
What you can do after
Build exact GPyTorch GP models, visualize predictive distributions, train them with gradient descent, and use them within BayesOpt.

Read how Bayesian Optimization in Action explains Gaussian process →

AI-Powered Search

A Gaussian process is a collection of random variables whose finite subsets have joint Gaussian distributions and that defines a probability distribution over functions.

How it is used
Balances exploitation of known ranking behavior with exploration of underobserved query–document combinations.
How deep it goes
Explains probabilistic prediction, uncertainty, expected improvement, and implementation, but stops short of deriving Gaussian-process mathematics.
Examples
Uses river-depth observations, feature combinations, and the “transformers dvd” product-selection example.
What you can do after
Apply it via scikit-learn to rank search candidates by expected improvement and select products for exploration.

Read how AI-Powered Search explains Gaussian process →

Machine Learning Algorithms in Depth

A Gaussian process is a collection of random variables such that every finite subset has a jointly Gaussian distribution, defining a probability distribution over functions.

How it is used
Models a distribution over functions for continuous-value regression and for performance functions in Bayesian optimization.
How deep it goes
Derives noiseless regression predictions by Gaussian conditioning and implements a radial basis function example from scratch.
Examples
Uses CO₂ prediction, prior-versus-posterior samples, and hyperparameter searches for support vector machines and random forests.
What you can do after
Build it from scratch to compute regression posterior predictions, then evaluate/understand its role in Bayesian optimization.

Read how Machine Learning Algorithms in Depth explains Gaussian process →

Grokking Bayes

A Gaussian process is a probability distribution over functions such that every finite collection of function values has a joint Gaussian distribution.

How it is used
Extends Bayesian linear regression when linear relationships are too restrictive.
How deep it goes
Interprets Gaussian processes as infinite-degree polynomial models but defers detailed treatment and applications.
Examples
Uses linear relationships, higher-degree polynomials, and complex real-world trends as comparison points.
What you can do after
Evaluate/understand Gaussian processes as flexible generalizations of Bayesian linear regression for complex trends.

Read how Grokking Bayes explains Gaussian process →

Also covered in

What to know first

Related concepts

Questions about Gaussian process

What is Gaussian process?

A Gaussian process is a probability distribution over functions in which every finite collection of function values has a joint Gaussian distribution.

Which Manning books explain Gaussian process?

Bayesian Optimization in Action, AI-Powered Search, Machine Learning Algorithms in Depth and Grokking Bayes.

What should I know before learning Gaussian process?

Manning books that teach Gaussian process usually introduce posterior probability, Bayesian linear regression, exploitation and kernel function first.

What is Gaussian process a kind of?

Gaussian process is a kind of language model. A language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.

What are the parts of Gaussian process?

Gaussian process includes covariance function and mean function.

What is Gaussian process also called?

Gaussian process is also called GPs.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.