chapter six

6 Coincidence? I think NOT!

 

This chapter covers

  • Intuition behind hypothesis testing and p-values
  • Hypothesis testing for means, using two-tailed and one-tailed tests
  • p-values and how to interpret them
  • How to approach smaller samples and proportions with hypothesis testing

A hypothesis is a premise or claim we want to test, such as “Does my 305 mL can of soda really contain 305 mL?” Just because the can advertises 305 mL (the null hypothesis, or the “status quo” claim) doesn’t mean that it is true (which we call the alternative hypothesis, or a claim challenging the null hypothesis). Perhaps the soda factory equipment changed, or maybe the company is erring on being over (or under) 305 mL.

Hypothesis testing is a statistical experiment we conduct to test the claim. In the case of our can of soda, we are testing the claim that it is 305 mL as advertised. But to do that, we need to take a sizable sample (textbooks say more than 30 cans, as rules of the central limit theorem apply here). Then we measure the sample mean and standard deviation, and show that the sample is not just different, but very different, from the claims about the population. Only then can we give credibility to challenging the claim.

Hypothesis testing big ideas

Chasing the truth

Types of hypothesis tests for normal/t-distributions

Two-tailed tests

Level of significance for two-tailed tests

A two-tailed test

Two-tailed p-values

One-tailed tests

Level of significance for one-tailed tests

A one-tailed test

One-tailed p-values

Hypothesis testing with smaller samples

Hypothesis testing with proportions

Independent samples

Summary