liveBook · Manning

Constraint function

As explained in Bayesian Optimization in Action

A constraint function is a function whose value determines whether a candidate satisfies a specified optimization constraint.

A constraint function determines whether a candidate satisfies an optimization constraint. In constrained Bayesian optimization, its value can represent a cost that must remain nonpositive; feasible candidates satisfy the specified bounds. section 8.1.2

When the constraint function is a black box, its values are observed only at queried points. A separate Gaussian process models each constraint function, allowing the optimizer to estimate the probability that a new point is feasible rather than assuming the feasible region is known. section 8.1.2 section 8.6

A constraint-aware optimization loop uses constraint functions to:

  • Train one Gaussian process on the observed values of each constraint function. section 8.1.2
  • Estimate each candidate's probability of feasibility from the predictive distribution. section 8.6
  • Combine feasibility with objective improvement by incorporating that probability into constrained expected improvement. section 8.6

How Bayesian Optimization in Action covers it

How deep it goes
Defines black-box modeling and probabilistic feasibility, but does not detail Gaussian-process internals.
Examples
Uses a black-box cost function whose value must be nonpositive as the constraint example.
What it assumes
Assumes familiarity with Bayesian optimization and Gaussian-process prediction.
What you can do after
Apply constrained expected improvement with objective and constraint Gaussian processes in BoTorch.
How it connects
Connects Gaussian processes, Bayesian optimization, probability of feasibility, and expected improvement.

Also explained in

Compare how 2 books explain constraint function →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Bayesian Optimization in Action. The section links point to the parts of the book it draws on.