AP Statistics · Unit 4 · Inference for Quantitative Data: Means
4.10 Carrying out a two-mean test
Calculate a two-sample t statistic and p-value, decide whether to reject the null hypothesis, and interpret the result in context.
1/5The t statistic measures the difference in standard errors
- The t statistic measures the difference in standard errors
- Technology turns the t statistic into a p-value
- Comparing the p-value with the significance level gives a decision
- A conclusion must link the decision to the context
- A p-value is not the probability that the null hypothesis is true
- Check your recall
- Practice: 10 questions
Part 1 of 5: The t statistic measures the difference in standard errors
A test that is already set up needs one number that summarizes the data. That number is the t statistic. It divides the observed difference in sample means by its standard error.
Use . The denominator combines the variability from both samples. A large value of means the sample difference is far from 0 compared with chance variation.
Keep extra digits in the denominator and round only the final answer. When the null hypothesis is true, the statistic follows a distribution. That lets us judge whether a given value is unusual. Check the conditions from the setup step first.
Worked example
Calculating t
- Word equation: equals the observed difference minus the null value, over the standard error.
- Symbol equation: .
- Substitute: .
- Evaluate the variance terms: and .
- Find the standard error: .
- Divide: .
Answer: . Technology gives about 75.1 degrees of freedom.
Key term
t statistic
The t statistic is the test statistic for a mean or mean difference, using sample standard deviations to estimate the standard error.
Part 2 of 5: Technology turns the t statistic into a p-value
The next question is how unusual that value would be if the means were equal. Assume the null hypothesis is true. The p-value is the probability of getting a statistic this extreme or more, in the direction of .
Use technology to find it. On a calculator, choose the two-sample t-test, enter the summary statistics, and select the alternative. Software also reports the degrees of freedom. A small p-value means the observed difference would be unusual if the means were equal.
A one-sided test uses one tail area. A two-sided test doubles the tail area, because extreme results in either direction count against .
Key term
p-value
The p-value is the probability, assuming is true, of a test statistic at least as extreme as observed, in the direction of .

Quick check
One question on the part you just read
Easy
Show answer and explanation
Answer: C · Worked explanation
Part 3 of 5: Comparing the p-value with the significance level gives a decision
A p-value needs a standard for “small enough.” The significance level, , sets that standard before the data are examined. Common choices are 0.05 and 0.01. Choose it before looking at the data. Choosing afterward would let the result set its own standard.
If the p-value is less than or equal to , reject . The result then has statistical significance. If the p-value is greater than , fail to reject .
Decision rule for a test with significance level \lpha
- Comparison
- p-value
- Decision about
- Reject
- Evidence for
- Convincing
- Comparison
- p-value
- Decision about
- Fail to reject
- Evidence for
- Not convincing
Key terms · tap one for its definition
significance level
The significance level is the cutoff , chosen before seeing the data; a p-value at or below it leads to rejecting .
statistical significance
Statistical significance is the status of a result whose p-value is less than or equal to the significance level.
Part 4 of 5: A conclusion must link the decision to the context
A decision alone is incomplete. A full conclusion compares the p-value with , states the decision about , and answers in context. It refers to the population means, not only to the samples.
A reliable pattern has two sentences. First: “Because the p-value of ___ is less (or greater) than ___, we reject (or fail to reject) .” Second: “There is (or is not) convincing statistical evidence that [claim in context].”
Worked example
Writing a conclusion
- Compare: .
- The p-value is below the significance level, so reject .
- Answer in context, about the mean quiz scores.
Answer: Because the p-value of 0.030 is less than 0.05, we reject . There is convincing statistical evidence that the true mean score is higher with the app than with the printed guide.

Quick check
One question on the part you just read
Easy
Show answer and explanation
Answer: A · Worked explanation
Part 5 of 5: A p-value is not the probability that the null hypothesis is true
Take the app study, where the p-value is 0.030. Suppose the true means were equal. A sample difference of 4.3 points or more would then occur by chance about 3% of the time.
The p-value is not the probability that is true. It also says nothing about how large or important the difference is. A tiny difference can give a small p-value when samples are large.
The scope of the conclusion depends on the design. Random sampling lets you generalize to the population sampled. Random assignment supports a cause-and-effect conclusion.
Check your recall[13 marks]
5 written questions. Answer each one in your head or on paper, then open the mark scheme.
- 1.Calculate[3 marks]
Calculate the test statistic for using , , , , , and .
Show mark schemeHide mark scheme
Model answer
.
- 1 mark for substituting the values into the two-sample formula
- 1 mark for obtaining a standard error of
- 1 mark for obtaining
- 2.Determine[3 marks]
A two-sided test of whether mean sleep differs for students who use a bedtime app and students who do not gives a p-value of 0.082. Determine the decision at and give the conclusion in context.
Show mark schemeHide mark scheme
Model answer
The p-value of 0.082 is greater than 0.05, so we fail to reject . There is not convincing statistical evidence that mean sleep differs between app users and non-users.
- 1 mark for comparing 0.082 with 0.05 and noting the p-value is larger
- 1 mark for deciding to fail to reject
- 1 mark for concluding in context that there is not convincing evidence of a difference in mean sleep
- 3.Interpret[3 marks]
A test of whether a new fertilizer raises mean yield () gives a p-value of 0.04. Interpret this p-value in context.
Show mark schemeHide mark scheme
Model answer
If the true mean yields were equal, there would be about a 4% probability of getting a sample difference in mean yield at least as large as the one observed, just by chance.
- 1 mark for assuming the true mean yields are equal
- 1 mark for giving the probability as about 4% (0.04)
- 1 mark for referring to a sample difference in mean yield at least as large as observed, by chance
- 4.Explain[2 marks]
Explain why a p-value of 0.04 does not mean there is a 4% chance that is true.
Show mark schemeHide mark scheme
Model answer
The p-value is calculated assuming is true. It gives the probability of data at least this extreme, not the probability that the hypothesis itself is true.
- 1 mark for stating that the p-value is computed assuming is true
- 1 mark for stating that it is a probability about the data, not about the hypothesis
- 5.Describe[2 marks]
Describe how the p-value for a two-sided test is found from the t curve.
Show mark schemeHide mark scheme
Model answer
Find the area in the tail beyond the observed t value. Double that area, because results as extreme in either direction count.
- 1 mark for finding the tail area beyond the observed t value
- 1 mark for doubling it to include both directions

Practice this topic
10 quick-fire multiple-choice questions, easy to hard. Tap an answer to see if you're right and the worked explanation. (The written questions with mark schemes are under “Check your recall” above.)
0 right0 of 10 answered
Includes the 2 quick checks in the note above.
EasyIdentify[1 mark]
Show answer and explanation
Answer: D · Worked explanation
MediumCalculate[1 mark]
Show answer and explanation
Answer: B · Worked explanation
MediumCalculate[1 mark]
Show answer and explanation
Answer: B · Worked explanation
MediumInterpret[1 mark]
Show answer and explanation
Answer: D · Worked explanation
MediumDetermine[1 mark]
Show answer and explanation
Answer: A · Worked explanation
HardDetermine[2 marks]
Show answer and explanation
Answer: C · Worked explanation
Hard[2 marks]
Show answer and explanation
Answer: D · Worked explanation
Hard[2 marks]
Show answer and explanation
Answer: A · Worked explanation