liveBook · Manning

Noise

As explained in Grokking Bayes

Noise is variation in observed data caused by measurement error, unmodeled factors, or other randomness unrelated to the modeled relationship.

Observation noise is random variation in measured or observed values that the underlying model does not explain. It can come from rounding errors, unmeasured differences between cases, or other unpredictable effects. Positive and negative noise are treated as equally likely, while large deviations are less likely than small ones. section 3.11 section 9.7

Noise matters because it changes how confidently a model should interpret data:

  • Fitting every noisy fluctuation can produce overfitting and patterns that do not generalize. section 3.11
  • A zero-mean normal model represents deviations that are equally likely to be positive or negative. section 3.13
  • A larger variance represents a wider range of plausible measurement errors. section 9.7

House prices and CO₂ measurements

In a linear house-price model, noise slightly corrupts the relationship between area and price: y = mx + ε. Rounding in reported prices and house-specific features may explain ε. In a time-series model, a measured CO₂ value similarly equals the underlying latent state plus Gaussian observation noise. section 3.13 section 9.7

𝑦ᵢ = 𝑥ᵢ+ 𝑟,

The observation equation shows how a measured value combines an underlying state with noise. section 9.7

How Grokking Bayes covers it

How deep it goes
Defines zero-mean Gaussian noise, variance choices, and consequences for overfitting, but defers broader noise causes.
Examples
Uses house-price reporting errors, unmeasured house differences, synthetic regression data, and annual CO₂ measurements.
What it assumes
Assumes basic linear-model variables and introduces measurement uncertainty through concrete examples and light normal-distribution notation.
What you can do after
Apply it via probabilistic regression or Kalman filtering to represent uncertainty in predictions and measurements.
How it connects
Connects noise with linear regression, Bayesian inference, Gaussian distributions, state-space models, and Kalman filters.

Also explained in

Compare how 16 books explain noise →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Grokking Bayes. The section links point to the parts of the book it draws on.