Expected improvement
Expected improvement is a Bayesian optimization acquisition function that estimates a candidate’s expected gain over the best observed objective value while accounting for predictive uncertainty.
Bayesian Optimization in Action
Expected improvement is a Bayesian optimization acquisition function that quantifies the expected amount by which evaluating a candidate may improve on the best observed objective value.
- How it is used
- Ranks candidate evaluations in Bayesian optimization by expected improvement over the incumbent.
- How deep it goes
- Develops EI from improvement intuition through probabilistic magnitude, closed-form scoring, BoTorch use, and a batch extension.
- Examples
- Uses validation-accuracy tuning, a one-dimensional objective search, and BoTorch acquisition construction.
- What you can do after
- Apply it via BoTorch to select and optimize the next Bayesian optimization query.
Read how Bayesian Optimization in Action explains expected improvement →
AI-Powered Search
Expected improvement is a Bayesian-optimization acquisition function that scores candidates by their expected gain over the current best result while accounting for predictive uncertainty.
- How it is used
- Guides active-learning exploration by choosing search candidates with the highest predicted upside for live-user evaluation.
- How deep it goes
- Explains the basic formula and implementation, but defers advanced Bayesian-optimization details.
- Examples
- Uses product features, logged judgments, uncertainty tables, and a "transformers dvd" exploration query.
- What you can do after
- Apply it via Python to rank candidate feature vectors and select products for search-engine exploration.
Build AI Drug Discovery Pipelines
Expected improvement is an acquisition criterion that estimates the expected amount by which a candidate will improve on the best observed result.
- How it is used
- Balances exploration and exploitation when selecting molecules for active-learning virtual screening.
- How deep it goes
- Defines EI as an acquisition function but defers its implementation to a Python notebook rather than showing its code here.
- Examples
- Uses VEGFR-2 kinase screening, PDB ID 4AG8, molecular fingerprints, docking, and recovery of 73 top-100 molecules after 10 iterations.
- What you can do after
- Apply it via an active-learning acquisition strategy to prioritize promising compounds for expensive docking or related calculations.
Read how Build AI Drug Discovery Pipelines explains expected improvement →
Also covered in
What to know first
- exploitationIn optimization and decision-making, exploitation is selecting an option currently believed, based on available information, to yield high value.
- Gaussian processA Gaussian process is a probability distribution over functions in which every finite collection of function values has a joint Gaussian distribution.
- Bayesian optimizationBayesian optimization is a sequential method for optimizing an expensive or unknown objective by using a probabilistic model to guide evaluations.
- exploration-exploitation trade-offThe exploration-exploitation trade-off is the decision problem of balancing actions that gather information about uncertain alternatives with actions chosen for their currently expected payoff.
Related concepts
- Bayesian optimizationkind of · Bayesian optimization is a sequential method for optimizing an expensive or unknown objective by using a probabilistic model to guide evaluations.
- constrained expected improvementincludes · Constrained expected improvement is a Bayesian optimization acquisition function whose score is the expected improvement multiplied by the probability that the candidate satisfies the constraints.
- ExpectedHypervolumeImprovementincludes · ExpectedHypervolumeImprovement is a BoTorch acquisition-function class that computes analytic expected hypervolume improvement for multiobjective Bayesian optimization.
- policykind of · A policy is a rule, principle, or decision function that governs behavior or determines actions or permissions under specified conditions.
- acquisition functionkind of · An acquisition function is a scoring rule that ranks candidate evaluations by their expected usefulness for selecting the next sample or experiment.
Questions about expected improvement
What is expected improvement?
Expected improvement is a Bayesian optimization acquisition function that estimates a candidate’s expected gain over the best observed objective value while accounting for predictive uncertainty.
Which Manning books explain expected improvement?
Bayesian Optimization in Action, AI-Powered Search and Build AI Drug Discovery Pipelines.
What should I know before learning expected improvement?
Manning books that teach expected improvement usually introduce exploitation, Gaussian process, Bayesian optimization and exploration-exploitation trade-off first.
What kinds of expected improvement are there?
Kinds of expected improvement include constrained expected improvement and ExpectedHypervolumeImprovement.
What is expected improvement a kind of?
Expected improvement is a kind of Bayesian optimization. Bayesian optimization is a sequential method for optimizing an expensive or unknown objective by using a probabilistic model to guide evaluations.
What is expected improvement also called?
Expected improvement is also called EI.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.


