IB Mathematics: Applications and Interpretation · Topic 4 · Statistics and probability
4.18 Hypothesis testing
Formulate null and alternative hypotheses, carry out a test with sample data, interpret the p-value, and distinguish Type I from Type II errors.
1/5A hypothesis test weighs sample evidence against a claim
- A hypothesis test weighs sample evidence against a claim
- A small p-value is evidence against the null hypothesis
- A test follows five steps from hypotheses to conclusion
- A conclusion must be worded carefully and in context
- A test can make a Type I or a Type II error
- Check your recall
- Practice: 10 questions
Part 1 of 5: A hypothesis test weighs sample evidence against a claim
A cereal company claims that 30% of its boxes contain a prize. A student suspects the true figure is higher.
The company’s claim becomes the null hypothesis, . It says nothing unusual is happening, so . Here is the proportion of boxes with a prize. The null hypothesis always contains an equals sign.
The student’s suspicion is the alternative hypothesis, . In this case . A test with in one direction is one-tailed, and one with is two-tailed.
Forms of the alternative hypothesis
- Test
- One-tailed, upper
- for
- What it looks for
- An increase
- Test
- One-tailed, lower
- for
- What it looks for
- A decrease
- Test
- Two-tailed
- for
- What it looks for
- A change in either direction
Key terms · tap one for its definition
null hypothesis
The null hypothesis is the default claim about a population parameter, assumed true unless the sample gives strong evidence against it.
alternative hypothesis
The alternative hypothesis is the statement about the population parameter that the data support when is rejected.
Part 2 of 5: A small p-value is evidence against the null hypothesis
Before collecting data, decide how much surprise counts as convincing. This threshold is the significance level, , usually 5% or 1%.
After sampling, we find the p-value. It is the probability of a result at least as extreme as ours, assuming is true.
If the p-value is smaller than , we reject . Otherwise, we do not reject . A p-value near 0 means the sample would be very surprising if were true.
A smaller demands stronger evidence before is rejected. Choosing after seeing the data would let you bend the result.
Key terms · tap one for its definition
significance level
The significance level is the probability, set before the test, below which a p-value leads to rejecting .
p-value
The p-value is the probability, assuming is true, of obtaining a result at least as extreme as the one observed.

Quick check
One question on the part you just read
Easy
Show answer and explanation
Answer: A · Worked explanation
Part 3 of 5: A test follows five steps from hypotheses to conclusion
Now we can put the pieces together. Take the cereal claim. A student buys 20 boxes and finds 10 with a prize. If is true, the number of prizes is . The calculator’s cumulative binomial function then gives the tail probability.
- State and .
- Choose the significance level.
- Calculate the p-value from the sample, using technology.
- Compare the p-value with the significance level.
- Conclude in the context of the question.
Worked example
Test a claim about a proportion
- Hypotheses: and . Take .
- Under , , where is the number of prizes.
- The p-value is .
- Calculator: , so the p-value is about 0.0480.
- Compare: , so reject .
Answer: There is sufficient evidence, at the 5% level, that more than 30% of the boxes contain a prize.
Part 4 of 5: A conclusion must be worded carefully and in context
The decision is only half of the answer. Rejecting means the sample gives evidence for . It does not prove that is true.
Not rejecting means the evidence is insufficient. It does not prove that is true, because the sample may simply be too small. Write the conclusion in context.
In a two-tailed test, the p-value counts both tails. For a symmetric distribution, double the probability in the tail you calculated.

Quick check
One question on the part you just read
Easy
Show answer and explanation
Answer: A · Worked explanation
Part 5 of 5: A test can make a Type I or a Type II error
A jury can convict an innocent person or free a guilty one. Tests can fail in two matching ways. A Type I error is rejecting when it is true.
The probability of a Type I error equals the significance level . A Type II error is failing to reject when it is false.
Decisions and errors
- Truth
- is true
- Reject
- Type I error
- Do not reject
- Correct decision
- Truth
- is false
- Reject
- Correct decision
- Do not reject
- Type II error
Lowering makes a Type I error less likely but a Type II error more likely. A larger sample reduces the chance of a Type II error without changing .
Key terms · tap one for its definition
Type I error
A Type I error is the rejection of when is true; its probability equals the significance level.
Type II error
A Type II error is the failure to reject when is false.
Check your recall[14 marks]
6 written questions. Answer each one in your head or on paper, then open the mark scheme.
- 1.Distinguish[2 marks]
Distinguish between the null hypothesis and the alternative hypothesis.
Show mark schemeHide mark scheme
Model answer
The null hypothesis is the default claim, assumed true unless the sample gives strong evidence against it. The alternative hypothesis is the statement the data support if the null hypothesis is rejected.
- 1 mark for describing the null hypothesis as the default claim assumed true
- 1 mark for describing the alternative hypothesis as what is supported if is rejected
- 2.Define[2 marks]
Define the p-value.
Show mark schemeHide mark scheme
Model answer
The p-value is the probability of obtaining a result at least as extreme as the one observed, assuming the null hypothesis is true.
- 1 mark for stating that it is a probability of a result at least as extreme as observed
- 1 mark for stating the assumption that the null hypothesis is true
- 3.Determine[3 marks]
A company claims that 40% of its customers renew. In a sample of 25 customers, 6 renew. Test against at the 5% level. Under , and . Determine the conclusion.
Show mark schemeHide mark scheme
Model answer
The p-value is . Since , do not reject . There is insufficient evidence at the 5% level that fewer than 40% of customers renew.
- 1 mark for identifying the p-value as 0.0736
- 1 mark for comparing 0.0736 with 0.05 and not rejecting
- 1 mark for stating the conclusion in context
- 4.Describe[2 marks]
Describe a Type I error and a Type II error in the test of the cereal company’s claim that 30% of boxes contain a prize.
Show mark schemeHide mark scheme
Model answer
A Type I error is concluding that more than 30% of boxes contain a prize when the true proportion is 30%. A Type II error is finding insufficient evidence of this when the true proportion really is higher.
- 1 mark for describing a Type I error in context
- 1 mark for describing a Type II error in context
- 5.Explain[2 marks]
Explain why not rejecting the null hypothesis does not prove that it is true.
Show mark schemeHide mark scheme
Model answer
Not rejecting means only that the sample gave insufficient evidence against . A small sample may fail to show a real difference.
- 1 mark for stating that the evidence is insufficient rather than proof
- 1 mark for giving a reason, such as the sample being too small
- 6.Explain[3 marks]
Explain how lowering the significance level from 5% to 1% affects the chances of Type I and Type II errors for a fixed sample size.
Show mark schemeHide mark scheme
Model answer
The probability of a Type I error equals , so it falls from 5% to 1%. Rejecting becomes harder, so a Type II error becomes more likely.
- 1 mark for stating that the Type I error probability equals the significance level
- 1 mark for stating that a Type I error becomes less likely
- 1 mark for stating that a Type II error becomes more likely

Practice this topic
10 quick-fire multiple-choice questions, easy to hard. Tap an answer to see if you're right and the worked explanation. (The written questions with mark schemes are under “Check your recall” above.)
0 right0 of 10 answered
Includes the 2 quick checks in the note above.
EasyState[1 mark]
Show answer and explanation
Answer: A · Worked explanation
MediumDetermine[1 mark]
Show answer and explanation
Answer: A · Worked explanation
MediumDetermine[2 marks]
Show answer and explanation
Answer: A · Worked explanation
MediumDetermine[2 marks]
Show answer and explanation
Answer: A · Worked explanation
MediumIdentify[1 mark]
Show answer and explanation
Answer: A · Worked explanation
HardIdentify[2 marks]
Show answer and explanation
Answer: A · Worked explanation
HardIdentify[2 marks]
Show answer and explanation
Answer: A · Worked explanation
HardDeduce[2 marks]
Show answer and explanation
Answer: A · Worked explanation