In hypothesis testing, decision theory turns statistical evidence into action through rules established before the data is analyzed. The rule makes a decision systematic and reproducible, while acknowledging that uncertainty and the possibility of error remain. section 4.5 section 4.3.1
A Neyman–Pearson decision has two possible outcomes:
- Reject the null hypothesis, risking a Type I error if it is true. section 4.1.6
- Fail to reject the null hypothesis, risking a Type II error if a real effect goes undetected. Neither outcome proves its hypothesis true. section 4.1.6
A threshold does not erase nuance
With α = 0.05, p-values of 0.049 and 0.051 fall on opposite sides of the decision threshold despite providing nearly identical evidence against the null hypothesis. section 4.1.6

