liveBook · Manning

Expected improvement

Also called EI

Expected improvement is a Bayesian optimization acquisition function that estimates a candidate’s expected gain over the best observed objective value while accounting for predictive uncertainty.

How 3 Manning books explain it

Bayesian Optimization in Action

Expected improvement is a Bayesian optimization acquisition function that quantifies the expected amount by which evaluating a candidate may improve on the best observed objective value.

How it is used
Ranks candidate evaluations in Bayesian optimization by expected improvement over the incumbent.
How deep it goes
Develops EI from improvement intuition through probabilistic magnitude, closed-form scoring, BoTorch use, and a batch extension.
Examples
Uses validation-accuracy tuning, a one-dimensional objective search, and BoTorch acquisition construction.
What you can do after
Apply it via BoTorch to select and optimize the next Bayesian optimization query.

Read how Bayesian Optimization in Action explains expected improvement →

AI-Powered Search

Expected improvement is a Bayesian-optimization acquisition function that scores candidates by their expected gain over the current best result while accounting for predictive uncertainty.

How it is used
Guides active-learning exploration by choosing search candidates with the highest predicted upside for live-user evaluation.
How deep it goes
Explains the basic formula and implementation, but defers advanced Bayesian-optimization details.
Examples
Uses product features, logged judgments, uncertainty tables, and a "transformers dvd" exploration query.
What you can do after
Apply it via Python to rank candidate feature vectors and select products for search-engine exploration.

Read how AI-Powered Search explains expected improvement →

Build AI Drug Discovery Pipelines

Expected improvement is an acquisition criterion that estimates the expected amount by which a candidate will improve on the best observed result.

How it is used
Balances exploration and exploitation when selecting molecules for active-learning virtual screening.
How deep it goes
Defines EI as an acquisition function but defers its implementation to a Python notebook rather than showing its code here.
Examples
Uses VEGFR-2 kinase screening, PDB ID 4AG8, molecular fingerprints, docking, and recovery of 73 top-100 molecules after 10 iterations.
What you can do after
Apply it via an active-learning acquisition strategy to prioritize promising compounds for expensive docking or related calculations.

Read how Build AI Drug Discovery Pipelines explains expected improvement →

Also covered in

What to know first

Related concepts

Questions about expected improvement

What is expected improvement?

Expected improvement is a Bayesian optimization acquisition function that estimates a candidate’s expected gain over the best observed objective value while accounting for predictive uncertainty.

Which Manning books explain expected improvement?

Bayesian Optimization in Action, AI-Powered Search and Build AI Drug Discovery Pipelines.

What should I know before learning expected improvement?

Manning books that teach expected improvement usually introduce exploitation, Gaussian process, Bayesian optimization and exploration-exploitation trade-off first.

What kinds of expected improvement are there?

Kinds of expected improvement include constrained expected improvement and ExpectedHypervolumeImprovement.

What is expected improvement a kind of?

Expected improvement is a kind of Bayesian optimization. Bayesian optimization is a sequential method for optimizing an expensive or unknown objective by using a probabilistic model to guide evaluations.

What is expected improvement also called?

Expected improvement is also called EI.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.