liveBook · Manning

Cohen's d

As explained in Effective Data Analysis

Cohen's d is a standardized effect-size measure expressing the difference between two means in standard-deviation units.

Cohen’s d expresses the difference between two group means in standard-deviation units. It is an effect-size measure: it helps assess the magnitude of a difference, rather than only whether a statistical test finds one. section 4.2.1

With large samples, parametric tests can find statistically significant differences between nearly identical means. Cohen’s d offers a magnitude check that is not affected by sample size. Pair it with a minimum difference that matters in the domain, rather than treating significance alone as a recommendation. section 4.2.1

Deciding what matters

An average test-score difference of 0.5% may not matter, while a 0.2% increase in conversion rate could have meaningful revenue implications. Effect size informs that discussion; domain knowledge and a confidence interval help assess the difference against a chosen threshold. section 4.2.1

How Effective Data Analysis covers it

How deep it goes
Defines its purpose as an effect-size measure but stops short of a formula or worked Cohen’s d calculation.
Examples
Uses test-score differences and conversion-rate gains to illustrate why practical importance depends on context.
What it assumes
Assumes familiarity with group means and statistical significance; introduces Cohen’s d by its role rather than its calculation.
What you can do after
Evaluate/understand whether a statistically significant difference merits further consideration, without relying on significance alone.
How it connects
Links effect size to parametric tests, statistical significance, confidence intervals, and domain-specific thresholds.

Also explained in

Compare how 2 books explain Cohen's d →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Effective Data Analysis. The section links point to the parts of the book it draws on.