AP Statistics · Unit 3 · Inference for Categorical Data: Proportions
3.6 p-values
Interpret a p-value in context, explain what small and large p-values suggest about the null hypothesis, and separate statistical from practical significance.
1/5A p-value measures how unusual the sample result is
- A p-value measures how unusual the sample result is
- The p-value is an area in the tail of the null model
- Interpreting a p-value names the null, the result, and the context
- A small p-value is strong evidence against the null hypothesis
- A statistically significant result may still be too small to matter
- Check your recall
- Practice: 10 questions
Part 1 of 5: A p-value measures how unusual the sample result is
Suppose a game maker says a coin lands heads half the time. You flip it 100 times and get 62 heads. A fair coin could do that, but it would be unusual.
The null hypothesis is the claim being tested, a specific value for the population proportion. A p-value puts a number on how unusual the result is. It assumes the null hypothesis is true, then asks how likely a result at least this extreme would be.
Key term
p-value
The p-value is the probability, assuming the null hypothesis is true, of getting a sample proportion at least as extreme as the one observed.
Part 2 of 5: The p-value is an area in the tail of the null model
Now picture where that probability comes from. If the null hypothesis were true, sample proportions would pile up around the null value in a bell shape. Your observed result sits somewhere on that curve.
The p-value is the area in the tail beyond your result. A one-sided alternative uses one tail. A two-sided alternative counts both tails, so its p-value is double the one-tail area.
A result far out in the tail leaves little area, which gives a small p-value. The curve shows the null model only. It describes what random sampling would produce if the claim were true.

Quick check
One question on the part you just read
Easy
Show answer and explanation
Answer: A · Worked explanation
Part 3 of 5: Interpreting a p-value names the null, the result, and the context
Interpreting a p-value follows a fixed pattern. Each part has a job. A vague answer, such as the chance that the claim is true, is incorrect.
- Assume the null hypothesis is true, using the claimed value in context.
- Describe a sample result at least as extreme as the one observed.
- Give the probability, and say it comes from random sampling.
Worked example
Interpreting a p-value in context
- Assume the null is true: exactly 40% of all customers use a loyalty card.
- The sample result was 47%, so at least as extreme means 47% or higher.
- Write the probability in context: 0.022 is about 2.2%.
Answer: If 40% of all the shop’s customers use a loyalty card, there is about a 2.2% chance that a random sample of 200 customers has 47% or more users.
The statement is conditional. It begins by assuming the claim is true, because that assumption is what the p-value is built on.
Part 4 of 5: A small p-value is strong evidence against the null hypothesis
Now ask what the number means for the claim. A small p-value says the result would be unusual if the null hypothesis were true. That is evidence against the null. A large p-value says the result is not unusual, so the evidence against the null is weak.
To decide how small is small, compare the p-value with the significance level, . Common choices are 0.05 and 0.01. A result with a p-value at or below is statistically significant.
What different p-values suggest
- p-value
- Very small, such as 0.001
- Result under the null
- Very unusual
- Evidence against the null
- Very strong
- p-value
- Small, at or below
- Result under the null
- Unusual
- Evidence against the null
- Convincing
- p-value
- Large, above
- Result under the null
- Not unusual
- Evidence against the null
- Not convincing
Key terms · tap one for its definition
significance level
The significance level is a cutoff, set before seeing data, at or below which a p-value counts as convincing evidence against the null hypothesis.
statistically significant
Statistically significant describes a result whose p-value is at or below the chosen significance level .

Quick check
One question on the part you just read
Easy
Show answer and explanation
Answer: B · Worked explanation
Part 5 of 5: A statistically significant result may still be too small to matter
Significance has a second side in practice. We also ask about practical significance, which is whether an effect is large enough to matter in real life. The p-value alone cannot answer that.
Sample size drives the gap. A huge sample can give a small p-value for a tiny difference. A small sample can give a large p-value for a big one.
For example, 40,000 users with a success rate of 50.5% can be statistically significant against a claim of 50%. A half-point difference may not matter to anyone.
Key term
practical significance
Practical significance is whether the size of a difference or effect is large enough to matter in the real situation.
Check your recall[12 marks]
5 written questions. Answer each one in your head or on paper, then open the mark scheme.
- 1.Describe[3 marks]
A test of against about the proportion of students who ride a bus gives a p-value of 0.03 for a sample proportion of 0.31. Describe what the p-value means in context.
Show mark schemeHide mark scheme
Model answer
If 25% of all students ride a bus, there is about a 3% chance of a random sample giving a proportion of 0.31 or higher.
- 1 mark for assuming the null is true, that 25% of all students ride a bus
- 1 mark for referring to a sample proportion of 0.31 or greater
- 1 mark for giving the probability as about 3%, from random sampling
- 2.Explain[2 marks]
Explain what a small p-value suggests about the null hypothesis.
Show mark schemeHide mark scheme
Model answer
A small p-value means the result would be unusual if the null hypothesis were true. This gives convincing evidence against the null hypothesis.
- 1 mark for stating that the result would be unusual if the null were true
- 1 mark for concluding that there is convincing evidence against the null hypothesis
- 3.Identify[2 marks]
Identify whether a p-value of 0.08 is statistically significant at , and give a reason.
Show mark schemeHide mark scheme
Model answer
It is not statistically significant, because 0.08 is greater than 0.05.
- 1 mark for identifying the result as not statistically significant
- 1 mark for comparing 0.08 with the significance level of 0.05
- 4.Explain[3 marks]
Explain why a statistically significant result might not be practically significant.
Show mark schemeHide mark scheme
Model answer
A very large sample can give a small p-value even when the difference is tiny. The p-value does not measure the size of the effect. A tiny difference may be too small to matter in the real situation.
- 1 mark for stating that a large sample can give a small p-value for a tiny difference
- 1 mark for stating that the p-value does not measure effect size
- 1 mark for linking a tiny difference to not mattering in practice
- 5.Describe[2 marks]
Describe the mistake in saying that a p-value of 0.03 means there is a 3% chance the null hypothesis is true.
Show mark schemeHide mark scheme
Model answer
The p-value assumes the null hypothesis is true. It is the probability of a result at least this extreme, not the probability that the null is true.
- 1 mark for stating that the p-value is calculated assuming the null is true
- 1 mark for stating that it is the probability of the result, not of the null hypothesis

Practice this topic
10 quick-fire multiple-choice questions, easy to hard. Tap an answer to see if you're right and the worked explanation. (The written questions with mark schemes are under “Check your recall” above.)
0 right0 of 10 answered
Includes the 2 quick checks in the note above.
EasyIdentify[1 mark]
Show answer and explanation
Answer: C · Worked explanation
Medium[1 mark]
Show answer and explanation
Answer: D · Worked explanation
Medium[1 mark]
Show answer and explanation
Answer: A · Worked explanation
Medium[1 mark]
Show answer and explanation
Answer: B · Worked explanation
Medium[1 mark]
Show answer and explanation
Answer: C · Worked explanation
Hard[2 marks]
Show answer and explanation
Answer: A · Worked explanation
Hard[2 marks]
Show answer and explanation
Answer: D · Worked explanation
Hard[2 marks]
Show answer and explanation
Answer: B · Worked explanation