Effect size
An effect size is a quantitative measure of the magnitude of a difference, association, relationship, or other observed phenomenon, independent of statistical significance.
Statistics Slam Dunk
An effect size is a quantitative measure of the magnitude of a difference or relationship between groups or variables.
- How it is used
- Quantifies practical magnitude alongside significance tests when comparing NBA groups or relationships.
- How deep it goes
- Defines standardized mean differences, qualitative ratings, test selection, and record-count limits without deriving inferential formulas.
- Examples
- Uses home-versus-road fouls and free throws plus Gini coefficients for winning and championship teams.
- What you can do after
- Apply it via R packages to quantify and classify differences while retaining companion significance tests.
Effective Data Analysis
An effect size is a quantitative measure of the magnitude of a difference or relationship, independently of sample size.
- How it is used
- Distinguishes practically meaningful differences from statistical significance and supplies an input for study planning.
- How deep it goes
- Introduces Cohen’s d and practical thresholds, then uses a specified effect size in power analysis without deriving the measure.
- Examples
- Uses student test scores, conversion rates and a Boston–New York July weather comparison to frame meaningful differences and analysis.
- What you can do after
- Apply it via statsmodels to plan a t-test sample size and evaluate whether observed differences matter in context.
Also covered in
- Causal AI
- LLM Evaluation and Alignment, The Foundational IdeasIn early access (MEAP)
- Designing AI SystemsIn early access (MEAP)
- AI Model EvaluationIn early access (MEAP)
What to know first
- categorical dataCategorical data consists of values representing membership in discrete categories rather than measured numerical magnitudes.
- hypothesis testingHypothesis testing is a formal statistical procedure for evaluating evidence from observed data about a specified hypothesis, often a null hypothesis.
- meanThe mean is a measure of central location equal to the arithmetic average of numerical observations, or the probability-weighted average of a random variable’s possible values.
- null hypothesisA null hypothesis is a statistical claim about a population or data-generating process that serves as a reference assumption and is evaluated by a hypothesis test, often asserting no effect or difference.
Related concepts
- Cohen's dmeasured by · Cohen's d is a standardized effect-size measure expressing the difference between two group means in standard-deviation units, commonly using the pooled standard deviation.
- causationequivalent to · Causation is a relationship in which a change in one event, factor, or condition produces or influences a change in another.
- Cramer's Vincludes · Cramer's V is a normalized, directionless measure of association strength between categorical variables in a contingency table, ranging from 0 to 1.
- Glass's deltaincludes · Glass's delta is a standardized mean difference obtained by dividing the difference between two means by the standard deviation of a reference group.
- Hedges' gincludes · Hedges' g is a bias-corrected standardized effect-size measure for the difference between two group means.
Questions about effect size
What is effect size?
An effect size is a quantitative measure of the magnitude of a difference, association, relationship, or other observed phenomenon, independent of statistical significance.
Which Manning books explain effect size?
Statistics Slam Dunk and Effective Data Analysis.
What should I know before learning effect size?
Manning books that teach effect size usually introduce categorical data, hypothesis testing, mean and null hypothesis first.
What kinds of effect size are there?
Kinds of effect size include Cramer's V, Glass's delta and Hedges' g.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

