Chapter 4: The grand exhibit of normality
Introduces the normal distribution as a bell-shaped pattern in data and explains why it matters for statistical inference.
After this chapter you will be able to
- Bell-shaped data pattern. Explain why a bell-shaped curve in the frequency of observed values suggests that data is normally distributed.
- Normal distribution in inference. Explain why the normal distribution matters beyond describing bell-shaped data: it helps infer population attributes from a sample and underpins later techniques such as confidence intervals and hypothesis testing.
- Normal distribution shape and parameters. Describe a normal distribution as a symmetrical, bell-shaped probability distribution whose mean marks its center and whose standard deviation determines its spread.
- Center and tail likelihoods. Explain how the area and shape of the normal curve relate to expected values: its total area is 1.0, values near the center are most likely, and values toward the tails are less likely.
- Bell shape and area. Describe the normal curve’s symmetry, where most of its area lies, and what its total area represents.
- Mean and curve location. Explain how the mean determines where a normal distribution sits on the x-axis.
- Standard deviation and spread. Explain how standard deviation changes the curve’s width and what that means for variability, predictability, and total area.
- Bell-Shaped Coffee Responses. Describe the pattern in the baristas’ reported coffee amounts and explain why it suggests a normal distribution.
- Normal Curve Parameters. Describe how the sample mean and standard deviation are used to plot a normal curve, and why the plotted probability distribution has an area of 1.0.
- Normal PDF parameters and output. Explain that the normal distribution PDF produces y-values for a bell curve, with mean µ and standard deviation σ as its only parameters; π and e are constants.
- Zero probability of exact weights. Explain why a golden retriever weighing exactly 61.63 pounds has probability zero under a continuous normal distribution, even though a scale may display that weight.
- Density versus range probability. Distinguish the probability density at a weight from the probability of a range of weights, and describe how area under the normal curve represents the latter.
- CDF subtraction for intervals. Describe what a normal CDF returns and apply subtraction of two CDF values to find the probability between two weights.
- Normal distribution empirical rule. State when the empirical rule applies and describe the approximate proportions of data within one, two, and three standard deviations of the mean.
- Coffee measurement ranges. Apply the empirical rule by adding and subtracting multiples of the standard deviation from the mean to find ranges containing approximately 68%, 95%, and 99.7% of normal data.
- Skepticism about sigma claims. Explain why an apparently extraordinary sigma event can prompt scrutiny of a model rather than automatically excuse an unfavorable outcome.
- Chebyshev’s minimum percentage bound. Explain when to use Chebyshev’s theorem instead of the empirical rule and what its result means.
- Shape of sample means. Explain that the distribution formed by taking means of many sizable samples usually approximates a normal distribution, even when the population is skewed or has another nonnormal shape. Distinguish this approximation from the case of a normal population, whose sample means are normal even for small samples.
- Center of sample means. Describe how the mean of many sample means relates to the population mean, including the section’s qualification about covering the population versus getting close with sufficiently many samples.
- Spread of sample means. State how the standard deviation of sample means relates to the population standard deviation and sample size, and describe the section’s qualification about representing the population.
- Standard normal distribution. Explain that the standard normal, or Z-distribution, is a normal distribution with mean 0 and standard deviation 1, and that Z-scores express values in standard-deviation units.
- Z-score calculation and interpretation. Apply the Z-score conversion to the coffee example and explain why 40 grams is unusually high relative to a mean of 27.6 grams and a standard deviation of 3.2 grams.
- Recognizing a log-normal pattern. Explain why taking the logarithm of the right-skewed tornado width data suggests it may follow a log-normal distribution.
What it builds on
- Probability distributions (chapter 3) · Introduces probability distributions.
- Samples and populations (chapter 2) · Introduces samples and populations.
- Mean (chapter 2) · The meaning of the mean.
- Standard deviation (chapter 2) · The meaning of standard deviation.
- Real numbers (chapter 2) · Real numbers as possible values for a measurement.
- Sampling bias (chapter 2) · The possibility of sampling bias.
- What is a sample? (chapter 2) · The distinction between a sample and a population.
- Real-world example with tornadoes (chapter 2) · The tornado dataset used earlier in the book.
Section by section
Introduction
Introduces the normal distribution as a bell-shaped pattern in data and explains why it matters for statistical inference.
- Bell-shaped data pattern: Explain why a bell-shaped curve in the frequency of observed values suggests that data is normally distributed.
Why it matters: This gives you a visual clue for recognizing when the normal distribution may describe data. - Normal distribution in inference: Explain why the normal distribution matters beyond describing bell-shaped data: it helps infer population attributes from a sample and underpins later techniques such as confidence intervals and hypothesis testing.
Why it matters: It explains why the book gives this distribution a central place before moving to inference.
Key terms: normal distribution, bell-shaped curve, frequency of values, population, sample, confidence intervals, hypothesis testing
4.1 The normal distribution
Introduces the normal distribution’s bell shape, explains how to read its center and spread, and shows why that shape is useful in practical design.
- Normal distribution shape and parameters: Describe a normal distribution as a symmetrical, bell-shaped probability distribution whose mean marks its center and whose standard deviation determines its spread.
Why it matters: The mean and standard deviation give you a way to describe where values cluster and how widely they vary. - Center and tail likelihoods: Explain how the area and shape of the normal curve relate to expected values: its total area is 1.0, values near the center are most likely, and values toward the tails are less likely.
Why it matters: Reading the curve this way helps you identify typical values without treating every value as equally likely. - Physical measurements in design: Describe how a distribution of physical measurements can guide a design intended to accommodate many people, using the section’s seat or game-controller example.
Why it matters: A distribution can turn measurements into a practical choice about whom a product will fit.
Key terms: normal distribution, Gaussian distribution, bell curve, mean, standard deviation, area under the curve, center, tails, normally distributed data, adult heights
4.2 Properties of the normal distribution
This section explains the normal distribution’s bell shape, total area, and how its mean and standard deviation control its position and spread.
- Bell shape and area: Describe the normal curve’s symmetry, where most of its area lies, and what its total area represents.
Why it matters: The curve’s shape and area provide the basis for interpreting where values are concentrated. - Mean and curve location: Explain how the mean determines where a normal distribution sits on the x-axis.
Why it matters: The mean tells you where the center of a normal distribution is located. - Standard deviation and spread: Explain how standard deviation changes the curve’s width and what that means for variability, predictability, and total area.
Why it matters: The standard deviation shows how tightly values cluster and how predictable they are around the mean.
Key terms: normal distribution, symmetrical, mean, area, tails, x-axis, location, standard deviation, spread, variability
4.3 Discovering the normal distribution
A barista survey shows how a bell-shaped set of measurements can be modeled with a continuous normal distribution, while leaving room for sampling error and bias.
- Bell-Shaped Coffee Responses: Describe the pattern in the baristas’ reported coffee amounts and explain why it suggests a normal distribution.
Why it matters: The shape of the observed data gives a reason to try a normal model rather than choosing one arbitrarily. - Continuous Coffee Measurement: Explain why coffee amounts are modeled as continuous even though the baristas reported whole grams.
Why it matters: Recorded precision should not be confused with the possible values of what is being measured. - Normal Curve Parameters: Describe how the sample mean and standard deviation are used to plot a normal curve, and why the plotted probability distribution has an area of 1.0.
Why it matters: These two sample statistics turn the observed pattern into a specific probability curve. - Population Prediction Limits: Explain what the fitted curve suggests about other baristas’ answers and why that prediction remains uncertain.
Why it matters: A curve that fits one survey is a useful prediction, not proof that every barista population follows it.
Key terms: histogram, bell shape, normal distribution, outliers, continuous distribution, discrete bins, floating-point real number, measurement precision, mean, standard deviation
4.4 The normal distribution formula
This section shows that the normal distribution’s PDF can be calculated from its mean and standard deviation to plot a bell curve, although libraries usually do the work more efficiently.
- Normal PDF parameters and output: Explain that the normal distribution PDF produces y-values for a bell curve, with mean µ and standard deviation σ as its only parameters; π and e are constants.
Why it matters: It clarifies which values you change when plotting a particular normal distribution. - From-scratch PDF versus libraries: Describe how a short standard-library Python implementation of the PDF can replace scipy’s norm.pdf() to plot the coffee-weight bell curve, and why scipy or numpy is generally preferable in practice.
Why it matters: It helps you choose between using the formula yourself and relying on a library.
Key terms: PDF, µ, σ, π, e, norm.pdf(), standard library, scipy, numpy, graphing calculator
4.5 Calculating probabilities with the normal distribution
Explains why probabilities in a normal distribution come from areas over ranges, then shows how to calculate those areas with a CDF.
- Zero probability of exact weights: Explain why a golden retriever weighing exactly 61.63 pounds has probability zero under a continuous normal distribution, even though a scale may display that weight.
Why it matters: It prevents a rounded measurement from being mistaken for the probability of one exact value. - Density versus range probability: Distinguish the probability density at a weight from the probability of a range of weights, and describe how area under the normal curve represents the latter.
Why it matters: It tells you what part of a normal-distribution plot answers a probability question. - CDF subtraction for intervals: Describe what a normal CDF returns and apply subtraction of two CDF values to find the probability between two weights.
Why it matters: It provides a practical way to calculate a normal-distribution range probability without doing calculus.
Key terms: continuous distribution, discrete, precision, probability density, area under the curve, probability, cumulative distribution function, CDF, norm.cdf(), left tail
4.6 Rules and theorems
This section previews rules and theorems about the normal distribution and a later discussion of non-normal data.
4.7 Empirical rule
This section uses the empirical rule to quantify typical ranges and extremes in normally distributed data, then cautions against treating extraordinary outcomes as proof of bad luck.
- Normal distribution empirical rule: State when the empirical rule applies and describe the approximate proportions of data within one, two, and three standard deviations of the mean.
Why it matters: The rule turns a mean and standard deviation into a quick description of what is typical. - Coffee measurement ranges: Apply the empirical rule by adding and subtracting multiples of the standard deviation from the mean to find ranges containing approximately 68%, 95%, and 99.7% of normal data.
Why it matters: You can put concrete boundaries on statements such as “most baristas” rather than judging a bell curve by eye. - Tail values and outliers: Explain how distance into a normal distribution's tails helps identify potentially unusual observations.
Why it matters: Distance from the mean offers a quick way to notice values worth a closer look. - Skepticism about sigma claims: Explain why an apparently extraordinary sigma event can prompt scrutiny of a model rather than automatically excuse an unfavorable outcome.
Why it matters: Calling a loss a rare event is not enough to establish that the model was sound or that no one bears responsibility.
Key terms: empirical rule, normal distribution, mean, standard deviation, perfect coffee measurement, tails, outlier, standard deviations, six-sigma event, law of truly large numbers
4.8 Chebyshev’s theorem
This section explains how Chebyshev’s theorem gives a minimum percentage of observations within a specified number of standard deviations when data is not normally distributed.
- Chebyshev’s minimum percentage bound: Explain when to use Chebyshev’s theorem instead of the empirical rule and what its result means.
Why it matters: It lets you describe the spread of nonnormal data without treating the empirical rule as universally applicable. - Computer chip lifespan example: Apply the section’s Chebyshev result to the computer chip lifespans and interpret the stated percentage.
Why it matters: The chip example shows how a standard-deviation range becomes a practical minimum-percentage statement.
Key terms: Chebyshev’s theorem, empirical rule, standard deviation, nonnormal data, at least K standard deviations, computer chip life expectancy
4.9 Central limit theorem
Explains how repeated sample means relate to a population’s mean and spread, and why their distribution can be approximately normal even when the population is not.
- Shape of sample means: Explain that the distribution formed by taking means of many sizable samples usually approximates a normal distribution, even when the population is skewed or has another nonnormal shape. Distinguish this approximation from the case of a normal population, whose sample means are normal even for small samples.
Why it matters: This lets you use a bell-shaped distribution of sample means even when the underlying data are not bell shaped. - Tornado sampling demonstration: Trace how the section uses tornado widths to illustrate the central limit theorem: repeatedly sample widths, compute one mean per sample, and plot those means rather than the individual widths.
Why it matters: The tornado example makes clear why the histogram of sample means can look unlike the histogram of the underlying measurements. - Center of sample means: Describe how the mean of many sample means relates to the population mean, including the section’s qualification about covering the population versus getting close with sufficiently many samples.
Why it matters: It connects repeated sample averages to the population quantity that sampling is meant to estimate. - Spread of sample means: State how the standard deviation of sample means relates to the population standard deviation and sample size, and describe the section’s qualification about representing the population.
Why it matters: It shows how sample size relates to the variability of sample averages, a relationship used in later inference.
Key terms: central limit theorem, sample means, population distribution, normal distribution, tornado width, random sample, histogram, population mean, standard deviation of the sample means, standard deviation of the population
4.10 Standard normal distributions and Z-scores
This section defines the standard normal distribution and shows how Z-scores express values in standard-deviation units, using a coffee example and noting that the conversion can be reversed.
- Standard normal distribution: Explain that the standard normal, or Z-distribution, is a normal distribution with mean 0 and standard deviation 1, and that Z-scores express values in standard-deviation units.
Why it matters: A Z-score lets you describe a value’s position without relying on its original units. - Z-score calculation and interpretation: Apply the Z-score conversion to the coffee example and explain why 40 grams is unusually high relative to a mean of 27.6 grams and a standard deviation of 3.2 grams.
Why it matters: The score quantifies just how unusual a proposed coffee amount is relative to the example distribution. - Forward and reverse conversion: Describe how to convert every value in a normal dataset to a Z-score and how to recover an original value when its Z-score, mean, and standard deviation are given.
Why it matters: Standardization does not discard the original scale when the mean and standard deviation are available.
Key terms: standard normal distribution, Z-distribution, Z-scores, Z-score, mean, standard deviation, Z-score conversion formula, original x-value
4.11 The log-normal distribution
This section shows how a logarithmic transformation can reveal a roughly normal shape in right-skewed data and make normal-distribution properties useful.
- Recognizing a log-normal pattern: Explain why taking the logarithm of the right-skewed tornado width data suggests it may follow a log-normal distribution.
Why it matters: A logarithm can reveal a useful pattern that is hard to see in the original skewed data. - Uses of the transformed shape: Describe what the approximately bell-shaped logarithms let us do with the tornado data and name the kinds of growing quantities the section says often work well with a log-normal distribution.
Why it matters: The transformed shape makes familiar normal-distribution tools relevant to data that looked skewed at first.
Key terms: log-normal distribution, logarithmic transformation, skewed to the right, bell curve, normal distribution properties, empirical rule
4.12 Summary
Where this is used later
- Confidence intervals with means (chapter 5) · Develops confidence intervals with means.
- One-sample tests for normal/t-distributions (chapter 6) · Develops one-sample tests for normal and t-distributions.
- Critical Z-values (chapter 5) · Assumes the symmetry and total area of a normal distribution.
- Torturing data and models (chapter 9) · Supports scrutiny of whether models and their assumptions reflect reality.
- Applying the central limit theorem (chapter 5) · Applies the central limit theorem to sampling.
- (chapter intro) (chapter 5) · The central limit theorem and its connection to sample means.
- Smaller samples with t-distribution (chapter 5) · The central limit theorem’s role in using normal-based methods.
- A two-tailed test (chapter 6) · Standard normal distributions and Z-scores.
Concepts explained in this chapter
- meanA measure of central tendency calculated as the arithmetic average of numerical observations.
- normal distributionA normal distribution is a continuous probability distribution characterized by a symmetric bell-shaped curve determined by its mean and standard deviation.
- continuous distributionA continuous distribution is a probability distribution whose variable can take values across a continuous range rather than only distinct countable values.
- standard deviationThe nonnegative square root of variance, measuring typical dispersion in the original units of a variable.
- Central Limit TheoremA theorem stating that, under suitable conditions, the distribution of sample means approaches a normal distribution as sample size increases, regardless of the population distribution's shape.
- probability densityA probability density function is a function whose values describe the relative likelihood of values of a continuous random variable.
- empirical ruleA rule stating that approximately 68%, 95%, and 99.7% of observations from a normal distribution lie within one, two, and three standard deviations of the mean, respectively.
- cumulative distribution functionA function that returns the probability that a random variable is less than or equal to a specified value.
- Law of Truly Large NumbersThe principle that a sufficiently large collection of opportunities makes the occurrence of even extremely unlikely events probable somewhere.
- scipy.stats.norm.cdfA SciPy function that returns the cumulative distribution function value for a normal distribution.
- sampling distributionThe probability distribution of a statistic, such as the mean, across repeated samples from a population.
- symmetrySymmetry is a property in which corresponding parts of a distribution mirror one another around a center.
- standard normal distributionA standard normal distribution is a normal distribution with mean zero and standard deviation one.
- z-scoreA standardized score expressing how many standard deviations an observation lies above or below a distribution's mean.
- natural numberA whole number is a nonnegative integer, including zero and excluding negative values and fractional values.
- floating-point valueA floating-point value is a computer representation of a real number using a significand and an exponent, subject to finite precision.
- real numberA real number is any number that can be represented as a point on the continuous number line.
- anomalyAn outlier is an observation that differs markedly from most other observations in a dataset.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.
