Surrogate model
A surrogate model is an approximate model that estimates the behavior or outputs of a more complex, costly, or otherwise unavailable model, process, or function.
Experimentation for Engineers
A surrogate function is a model that approximates a measured response as a function of parameter values and estimates the response at unmeasured values.
- How it is used
- Accelerates response-surface optimization by estimating business metrics at unmeasured parameter settings before validation.
- How deep it goes
- Works through one- and two-parameter quadratic regressions, interpolation grids, optimization, iteration, and validation.
- Examples
- Uses simulated trading markout profit over threshold and order size, plus CPU time from one Bayesian-optimization measurement.
- What you can do after
- Apply it via linear regression to estimate and optimize parameter settings, then validate the estimated optimum experimentally.
Read how Experimentation for Engineers explains surrogate model →
Bayesian Optimization in Action
A surrogate model is a predictive model that approximates an objective function from observed evaluations.
- How it is used
- Guides Bayesian optimization by predicting an objective from observed evaluations and quantifying uncertainty for decisions.
- How deep it goes
- Explains Gaussian-process probabilistic predictions, then develops multifidelity data formatting, correlation, cost modeling, and information-per-cost selection.
- Examples
- Uses ridge regression versus a Gaussian process, a Forrester approximation, neural-network early training, simulations, and Branin approximations.
- What you can do after
- Evaluate/understand when predictive uncertainty and cheaper approximate evaluations should guide expensive black-box optimization.
Read how Bayesian Optimization in Action explains surrogate model →
Outlier Detection in Python
A proxy model is an approximate model that imitates the behavior of another model or detector for analysis or explanation.
- How it is used
- Explains a black-box outlier detector by approximating its scores or labels with an interpretable model.
- How deep it goes
- Works through score regression, thresholded-label classification, cross-validation, tree-size limits, and interpretation rather than deriving surrogate algorithms.
- Examples
- Uses abalone Isolation Forest scores, 10-leaf decision trees, exported feature-threshold rules, and leaf-level outlier counts.
- What you can do after
- Apply it via scikit-learn to approximate detector outputs, check fidelity, and inspect interpretable paths without treating them as ground truth.
Read how Outlier Detection in Python explains surrogate model →
Ensemble Methods for Machine Learning
A surrogate model is an interpretable approximation trained to reproduce the behavior of a more complex model in a specified region or representation.
- How it is used
- Explains black-box ensemble behavior globally or individual predictions locally with interpretable approximations.
- How deep it goes
- Details surrogate-data construction, fidelity tradeoffs, decision trees, LIME weighting, and SHAP coalitions without deriving all optimization formulas.
- Examples
- Uses Bank Marketing XGBoost predictions, a 14-leaf decision-tree surrogate, and local explanations for test example 3104.
- What you can do after
- Evaluate/understand whether an interpretable model faithfully approximates a black box globally or near one prediction.
Read how Ensemble Methods for Machine Learning explains surrogate model →
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
A surrogate function is an approximate model of an objective function that predicts objective behavior across untested parameter settings.
- How it is used
- Guides Bayesian optimization toward promising machine-learning hyperparameters without exhaustively testing the search space.
- How deep it goes
- Explains updates, acquisition, exploration, exploitation, and model choices, but does not derive their mathematics.
- Examples
- Demonstrates Optuna tuning an XGBoost classifier and inspecting optimization history and hyperparameter importance.
- What you can do after
- Apply it via Optuna to search XGBoost hyperparameters and inspect the resulting best configuration and score.
Related concepts
- Optunaused by · Optuna is an open-source Python framework for automated hyperparameter optimization through repeated trials that explore parameter configurations.
- Bayesian optimizationused by · Bayesian optimization is a sequential method for optimizing an expensive or unknown objective by using a probabilistic model to guide evaluations.
- interpretabilityused by · Interpretability is the degree to which people can understand a model’s behavior, outputs, predictions, or the factors that produce them.
- black boxuses · A black box is a system or component whose internal workings are treated as opaque while its inputs, outputs, or observable behavior are considered.
- Gaussian processproduced by · A Gaussian process is a probability distribution over functions in which every finite collection of function values has a joint Gaussian distribution.
- labelcontrasts with · A label is a value or annotation associated with an item that identifies its target category, outcome, or reference answer for learning or evaluation.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.