liveBook · Manning

Null hypothesis

As explained in Causal AI

A null hypothesis is a statistical claim, typically asserting the absence of an effect or association, that is evaluated by a hypothesis test.

A null hypothesis (H0) is a statistical claim tested against an alternative hypothesis (Ha). In a conditional-independence test, H0 states that two variables are independent given specified controls; Ha states that they are not. The test calculates a statistic and p-value, then compares the p-value with a significance level such as .05 or .01. section 4.3.2

A frequentist test applies the null hypothesis through a compact decision workflow:

  • Specify variables X and Y, conditioning variables Z, and the null claim X ⊥ Y | Z. section 4.3.2
  • Compute a test statistic and p-value from observed data. section 4.3.2
  • Favor H0 when the p-value exceeds the significance threshold; favor Ha when it falls below it. section 4.3.2
  • Interpret a small p-value as evidence against the null claim, not as proof that the alternative is true. section 4.4.2

The null hypothesis becomes subtle when testing a causal DAG. A traditional test treats conditional independence as H0, so rejecting it indicates a dependence that conflicts with the graph. Yet a causal model predicts absences of patterns; rigorously, the model-right alternative would assert independence, while the null would assert dependence. Standard libraries generally support the traditional direction, making it a heuristic refutation method rather than a complete test of causal-model correctness. section 4.4.2

Transportation DAG

For a transportation survey, a graph implies E ⊥ T | O, R: education and travel should be independent after controlling for occupation and residence. A chi-squared test in pgmpy uses E, T, and [O, R] with a .05 significance level. Repeating the test across the graph’s d-separation statements identifies which predicted independences pass or fail. section 4.3.2

In DoWhy refutation, the null hypothesis instead states that the causal assumptions are not refuted. A p-value below .05 supports concluding that the assumptions are refuted, aligning the test direction with sensitivity analysis of an estimate. section 11.5

How Causal AI covers it

How deep it goes
Explains hypothesis direction, p-values, significance levels, and causal-testing limitations, but stops short of deriving test statistics.
Examples
Uses a transportation DAG, chi-squared tests, d-separation assertions, stock-price patterns, and DoWhy refuters.
What it assumes
Assumes basic variables and data familiarity while teaching hypothesis roles, p-value decisions, and causal-testing caveats explicitly.
What you can do after
Apply it via pgmpy or DoWhy to test conditional independences and assess whether causal assumptions are refuted.
How it connects
Connects null hypotheses to alternative hypotheses, conditional independence, p-values, significance levels, causal DAGs, and sensitivity analysis.

Also explained in

Compare how 4 books explain null hypothesis →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Causal AI. The section links point to the parts of the book it draws on.