liveBook · Manning

Residual error

As explained in Experimentation for Engineers

A residual is the portion of an observed value that remains unexplained after subtracting a model estimate.

A residual is the portion of a measurement left unexplained by a model: approximately the measurement minus its estimate. Modeling residuals focuses the next prediction step on what the baseline misses. section 6.2.1

Subtracting a mean baseline

For measurements 1.52 and 1.21, the mean estimate is 1.365. Subtracting it produces residuals of +0.155 and −0.155. Gaussian process regression then applies kernel-derived weights to these residuals and adds the mean back to form estimates. section 6.2.1

Residual-based estimation follows this pattern:

  • Subtract the baseline so the model works on unexplained variation. section 6.2.1

How Experimentation for Engineers covers it

How deep it goes
Defines residuals and works through weighted residual estimation, while deferring broader validation details such as LOOCV.
Examples
Uses CPU-time measurements, a mean baseline, kernel weights, and numerical Gaussian process estimates.
What it assumes
Assumes measurements and a baseline estimate, while establishing residual calculation from the mean.
What you can do after
Apply residual modeling in Python to produce weighted estimates from measured values.
How it connects
Connects residuals with model estimates, mean baselines, kernel functions, and Gaussian process regression.

Also explained in

Compare how 11 books explain residual error →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Experimentation for Engineers. The section links point to the parts of the book it draws on.