liveBook · Manning

Bayesian optimization

As explained in Timeless Algorithms, The Foundational Ideas

Bayesian optimization is a method for optimizing an expensive or black-box objective by using a probabilistic surrogate model to guide evaluations.

When each trial is costly, testing every possible setting can waste time. Bayesian optimization searches an expensive or time-consuming objective sequentially, using results from earlier evaluations to guide what to test next. section 2.4.1

The search proceeds by updating beliefs about the unknown relationship between candidate settings and performance:

  • Begin with a prior belief about how settings relate to the objective. section 2.4.1
  • Evaluate a candidate and use its observed result to update the prior into a posterior distribution. section 2.4.1
  • Choose the next candidate by balancing exploration of uncertain regions with exploitation of settings that have performed well. section 2.4.1

Tuning a model

For machine-learning hyperparameter tuning, candidate settings might vary a random forest’s number of trees, a neural network’s learning rate, or a decision tree’s depth. Each evaluation may require training and testing the model. section 2.4.1

How Timeless Algorithms, The Foundational Ideas covers it

How deep it goes
Explains prior-to-posterior updates and exploration–exploitation, but gives no acquisition function or implementation procedure.
Examples
Uses random-forest tree count, neural-network learning rate, and decision-tree depth as tuning examples.
What you can do after
Understand how sequential evidence guides candidate selection when objective evaluations are costly.
How it connects
Connects Bayesian inference and Bayes’ theorem with hyperparameter tuning, posterior distributions, grid search, and random search.

Also explained in

Compare how 6 books explain Bayesian optimization →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Timeless Algorithms, The Foundational Ideas. The section links point to the parts of the book it draws on.