liveBook · Manning

Bayesian linear regression

As explained in Grokking Bayes

Bayesian linear regression uses probability distributions to represent uncertainty about linear regression parameters and predictions.

Bayesian linear regression estimates a distribution over model parameters rather than only one slope. Observed data combine with a prior to produce a posterior, while predictions include uncertainty in both the parameters and observation noise. section 3.18

Predicting house prices

A simple model can relate a house’s square footage to its price, treating the slope as uncertain. The model can extend to multiple features, such as number of stories, location, and construction year, with a weight for each feature. section 3.16

Two practical ideas connect Bayesian linear regression to familiar modeling choices:

  • A stronger prior concentrates the posterior toward its prior mean, which can help when data are scarce and noisy. section 3.16
  • The normal–normal conjugate pair gives a normal posterior for real-valued parameters such as a regression slope. section 3.18
  • Gaussian processes generalize Bayesian linear regression to infinite-degree polynomials. section 3.18

How Grokking Bayes covers it

How deep it goes
Explains posterior uncertainty, conjugacy, multivariate extension, and regularization, while treating extensions only at a high level.
Examples
Uses house prices, square footage, multiple property features, and uncertain regression slopes as concrete examples.
What you can do after
Evaluate predictions while accounting for uncertainty in parameters and observation noise.
How it connects
Connects Bayesian linear regression to conjugate priors, regularization, posterior predictive distributions, and Gaussian processes.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Grokking Bayes. The section links point to the parts of the book it draws on.