liveBook · Manning

Practical importance

As explained in Timeless Algorithms, The Foundational Ideas

Practical significance is the real-world importance or usefulness of an effect, independent of whether it meets a statistical significance threshold.

Practical significance is the real-world importance of a result, not simply whether it crosses a statistical significance threshold. Large samples can make tiny, inconsequential differences statistically significant; modest effects can matter greatly when the stakes are substantial. section 4.1.7

Assess practical importance alongside effect size, domain knowledge, costs and benefits, and the investigation’s objectives. A conclusion should explain what the evidence implies while acknowledging assumptions, data quality, study scope, and remaining uncertainty. section 4.1.7

How Timeless Algorithms, The Foundational Ideas covers it

How deep it goes
Defines practical importance and names decision factors, without prescribing a calculation for it.
Examples
Contrasts tiny effects detected in large samples with modest effects that matter when stakes are substantial.
What it assumes
Assumes hypotheses, test choice, significance level, and test assumptions have already been established.
What you can do after
Evaluate findings using effect size, domain knowledge, costs, benefits, and study objectives alongside statistical decisions.
How it connects
Connects practical significance with hypothesis testing, statistical significance, effect size, and decision-making.

Also explained in

Compare how 2 books explain practical importance →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Timeless Algorithms, The Foundational Ideas. The section links point to the parts of the book it draws on.