liveBook · Manning

Probability density

As explained in Grokking Bayes

A probability density function describes the relative concentration of probability for a continuous random variable, with probabilities given by integrals over intervals.

A probability density describes the relative likelihood of values for a continuous hypothesis or random variable. Unlike discrete probability mass, it does not give the exact probability of one value. Integrating the density over a range gives the probability of that range. section 3.2

Think of the density curve as a landscape: probability comes from the area beneath a portion of the curve, not from the curve’s height alone. A uniform density from 0 to 1 has density 1 everywhere because its total area must equal 1; that does not mean every individual hypothesis has a 100% chance. section 3.2

The distinction from discrete probability becomes clearer in practice:

  • Use a probability mass function for discrete hypotheses, where individual probability values can be added. section 3.2
  • Use a probability density function for continuous hypotheses, where integration produces the probability of an interval. section 3.2
  • Interpret a density’s height as relative concentration rather than as the probability of the exact value beneath it. section 3.2

Density as a regression likelihood

In a linear model, y = mx + ε. If the slope m has a normal prior and ε is normally distributed noise, the observed y has a normal distribution whose PDF supplies its likelihood. For a prior 𝒩(100, 100²), multiplying the slope by x gives 𝒩(100x, 100²x²), and adding noise gives 𝒩(100x, 100²x² + 20000²). section 3.13

How Grokking Bayes covers it

How deep it goes
Defines density, explains area-based interpretation, and applies a normal PDF to regression likelihoods.
Examples
Uses a uniform distribution on 0–1 and a normal linear-regression likelihood with slope and noise.
What you can do after
Evaluate probabilities for continuous intervals and interpret PDF values correctly in Bayesian regression models.
How it connects
Connects probability density with probability mass functions, integrals, normal distributions, likelihoods, priors, and posterior distributions.

Also explained in

Compare how 8 books explain probability density →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Grokking Bayes. The section links point to the parts of the book it draws on.