liveBook · Manning

Quadratic model

As explained in Experimentation for Engineers

A response model containing constant, linear, squared, and possibly pairwise-product terms of its predictors.

A quadratic model approximates a response surface with a constant, linear, squared, and pairwise-product term for each predictor. In two dimensions, the design matrix is [1, x₁, x₂, x₁², x₂², x₁x₂], allowing interpolation between measured parameter settings. section 4.2.2

Use the model within an iterative response-surface workflow:

  • Measure the business metric at designed parameter settings and aggregate repeated observations with standard errors. section 4.2.2
  • Fit the coefficients with linear regression, evaluate the fitted surface over a fine grid, and select its predicted maximum. section 4.2.2
  • Shrink the parameter ranges around the current center when an extreme measurement suggests that the surface is too complex for the local model. section 4.2.2
  • Validate the proposed optimum by measuring it directly; return to design if the result falls outside the estimate’s 95% confidence bounds. section 4.2.2

Trading-parameter search

For threshold and order_size, repeated experiments eventually produce a well-behaved local surface. The fitted model predicts threshold = 1.12 and order_size = 3.0, with estimated markout profit 0.41; a final experiment tests that estimate. section 4.2.2

Table 4.2 Comparison of terms in the 1D and 2D models. The linear and quadratic (univariate) terms translate to 2D simply by adding a second term for x2. The cross term is new in 2D. It helps model behavior along the diagonals of the experiment design (CCD). (view table figure)

Terms

1D model

2D model

Constant

β0

β0

Linear

β1x1

β1x1 + β2x2

Quadratic (univariate)

β2x12

β3x12 + β4x22

Quadratic (cross)

N/A

β5x1x2

Compare one- and two-predictor models to see why the cross term is needed for diagonal behavior in the experiment design. section 4.2.2

How Experimentation for Engineers covers it

How deep it goes
Explains regression, grid interpolation, optimization, range reduction, and validation, but defers automated outlier detection.
Examples
Uses threshold and order_size experiments, repeated markout-profit measurements, coefficient fitting, and a predicted optimum.
What it assumes
Assumes measured responses and designed parameter settings, while demonstrating the two-dimensional regression workflow explicitly.
What you can do after
Apply it via linear regression and grid search, then validate the predicted optimum with a direct measurement.
How it connects
Connects response surface methodology, linear regression, surrogate functions, confidence bounds, and experimental design.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Experimentation for Engineers. The section links point to the parts of the book it draws on.