Scribe logoScribeNotes & practice
Sign inStart free
  1. Notes
  2. ›AP Statistics
  3. ›1 Exploring One-Variable Data and Collecting Data
  4. ›1.13 Experimental design

AP Statistics · Unit 1 · Exploring One-Variable Data and Collecting Data

1.13 Experimental design

Describe the key elements of a well-designed experiment, compare completely randomized and blocked designs, and explain why random assignment supports cause-and-effect conclusions.

  • 5 min read
  • 6 parts
  • 10 questions
  • Draft
Start a Quick 5 on this topic→Jump to the 10 questions
1/6An experiment assigns treatments to study cause and effect
  1. 1An experiment assigns treatments to study cause and effect
  2. 2Control keeps other influences from distorting the comparison
  3. 3Random assignment makes the treatment groups comparable
  4. 4Replication and blinding make the results more trustworthy
  5. 5Blocking separates a known source of variation
  6. 6Random assignment supports cause-and-effect conclusions
  7. Check your recall
  8. Practice: 10 questions
1

Part 1 of 6: An experiment assigns treatments to study cause and effect

A teacher wants to know whether a new study app raises quiz scores. She could compare students who already use it with students who do not. That comparison only observes what happened.

In an experiment, researchers assign a condition to each unit and then measure an outcome. Each condition is a treatment. Each individual that receives a treatment is an experimental unit. When the units are people, they are often called subjects.

Common mistake

A strong association in observed data does not prove cause and effect. Only a well-designed experiment can support that claim.

Key terms · tap one for its definition

experiment

An experiment is a study in which researchers assign treatments to experimental units and then measure a response.

treatment

A treatment is a specific condition that researchers assign to the experimental units in an experiment.

experimental unit

An experimental unit is a single individual, such as a person or plant, to which a treatment is assigned.

Part 1 done

2

Part 2 of 6: Control keeps other influences from distorting the comparison

Suppose the app group scores higher. Something other than the app could explain the gap. Students who choose the app may simply study harder.

That hidden factor is a confounding variable. It is related to the treatment and also affects the response, so their effects cannot be separated. Control is the main defense. Researchers compare treatments while holding other conditions the same.

A control group gives a baseline for comparison. Many studies give this group a placebo, an inactive treatment that looks real. It keeps expectations about improvement equal across the groups.

Key terms · tap one for its definition

confounding variable

A confounding variable is a variable related to the explanatory variable that also affects the response, so their effects cannot be separated.

control group

A control group is a group of experimental units that receives no treatment, a placebo or a standard treatment, for comparison.

placebo

A placebo is an inactive treatment designed to look and feel like the real treatment.

Part 2 done

Quick check

One question on the part you just read

Easy

Identify the feature that makes a study an experiment.
Show answer and explanation

Answer: B · Worked explanation

In an experiment, researchers impose a treatment on each unit. That separates it from simply watching existing groups. A large sample or a numerical response can occur in any study, so neither defines an experiment. The key is who decides the treatment.
3

Part 3 of 6: Random assignment makes the treatment groups comparable

Control handles differences that researchers can see. Chance must handle the rest. In random assignment, a chance process decides each unit’s treatment. Examples are drawing names or using a random number generator.

Because chance does the sorting, the groups should be alike before treatment. This holds even for variables nobody measured. A large difference afterward is unlikely to come from how the groups started.

A completely randomized design assigns all units to treatments at random, with no grouping first. For two treatments, the steps are:

  • Number the units.
  • Use a random device to pick half of them for the first treatment.
  • Give the remaining units the second treatment.
  • Measure the response for every unit.

Key terms · tap one for its definition

random assignment

Random assignment is the use of a chance process to decide which treatment each experimental unit receives.

completely randomized design

A completely randomized design is an experiment in which all experimental units are randomly assigned to the treatments.

Part 3 done

4

Part 4 of 6: Replication and blinding make the results more trustworthy

One unit per treatment would prove very little, even with random assignment. Good designs rely on replication, which means using many experimental units in each group. Chance differences between individuals then tend to average out, so a real treatment effect is easier to see.

People’s beliefs can also change results. Researchers use blinding to keep subjects, or those measuring the response, from knowing who received which treatment. In a double-blind study, neither group knows.

Exam tip

To justify replication, say that more units reduce the effect of chance variation. Do not say that it makes the groups identical.

Key terms · tap one for its definition

replication

Replication is the use of enough experimental units in each treatment group to reduce the effect of chance variation.

blinding

Blinding is keeping subjects, those measuring the response, or both unaware of which treatment each unit receives.

Part 4 done

Quick check

One question on the part you just read

Easy

Identify the main purpose of a placebo.
Show answer and explanation

Answer: A · Worked explanation

A placebo looks real but is inactive, so expectations are similar in both groups. Extra improvement in the treatment group is then more likely due to the treatment. Adding units is replication, and sorting units is blocking. A placebo also keeps the comparison fair.
5

Part 5 of 6: Blocking separates a known source of variation

Sometimes a variable is known to affect the response strongly. Random assignment might leave the groups unbalanced on it by chance. A block is a group of experimental units that are alike in a way expected to affect the response.

In a randomized block design, researchers first sort the units into blocks. They then assign treatments at random within each block. Treatments are compared among similar units, so variation between blocks does not cloud the comparison.

Figure 1. In a block design, the random split happens separately inside each block.

Two designs compared

FeatureCompletely randomizedRandomized block
First stepNumber all unitsSort units into blocks
Random assignmentAcross all unitsWithin each block
Best whenUnits are similarA known variable affects the response
Variation from the blocking variableLeft to chanceRemoved from the comparison
Feature
First step
Completely randomized
Number all units
Randomized block
Sort units into blocks
Feature
Random assignment
Completely randomized
Across all units
Randomized block
Within each block
Feature
Best when
Completely randomized
Units are similar
Randomized block
A known variable affects the response
Feature
Variation from the blocking variable
Completely randomized
Left to chance
Randomized block
Removed from the comparison

Common mistake

Blocks are not treatment groups. Units are grouped by a characteristic, and treatments are still assigned at random inside each block.

Key terms · tap one for its definition

block

A block is a group of experimental units that are similar in a way expected to affect the response.

randomized block design

A randomized block design is an experiment in which units are sorted into blocks and treatments are randomly assigned within each block.

Part 5 done

6

Part 6 of 6: Random assignment supports cause-and-effect conclusions

We can now see why an experiment supports a stronger claim than observation. Random assignment spreads confounding variables across the groups by chance. If the groups differ by more than chance alone would likely produce, the treatment is the most reasonable explanation. Without random assignment, a difference might come from the groups themselves rather than the treatment.

The conclusion applies to the units in the study. Random sampling, which uses chance to choose the units, supports generalizing to a larger population. Random assignment supports cause and effect. Random sampling supports generalization.

Worked example

Describing a complete design

A grower has 40 tomato plants, 20 on a sunny bench and 20 on a shaded bench. She wants to test whether a new fertilizer raises yield. Describe a suitable design.
  1. 1
    Treatments: the new fertilizer and no fertilizer, which serves as the control group.
  2. 2
    Block by bench, because light is expected to affect yield.
  3. 3
    Within each bench, randomly assign 10 plants to each treatment, for example by drawing numbered tags.
  4. 4
    Give every plant the same soil and watering so other conditions are controlled.
  5. 5
    Measure the yield of every plant and compare the treatments.

Answer: A randomized block design with two blocks, random assignment within each block, and a comparison of yield between the treatments.

Note read

Check your recall[13 marks]

5 written questions. Answer each one in your head or on paper, then open the mark scheme.

  1. 1.Explain[2 marks]

    Explain why an experiment often includes a control group.

    Show mark schemeHide mark scheme

    Model answer

    A control group gives a baseline for comparison. Differences in response can then be linked to the treatment rather than to other influences.

    • 1 mark for stating that the control group provides a baseline for comparison
    • 1 mark for linking differences in response to the treatment rather than other influences
  2. 2.Describe[3 marks]

    Describe how to carry out random assignment in a completely randomized design with 30 subjects and two treatments.

    Show mark schemeHide mark scheme

    Model answer

    Number the subjects from 1 to 30. Use a random device to pick 15 subjects for the first treatment. The remaining 15 receive the second treatment.

    • 1 mark for numbering or listing the subjects
    • 1 mark for using a random device to choose 15 subjects for one treatment
    • 1 mark for giving the other 15 subjects the second treatment
  3. 3.Explain[3 marks]

    Explain why random assignment allows cause-and-effect conclusions.

    Show mark schemeHide mark scheme

    Model answer

    Random assignment makes the treatment groups alike before treatment, including in variables that were not measured. Confounding variables are then spread across the groups by chance. A difference larger than chance would likely produce can be attributed to the treatment.

    • 1 mark for stating that random assignment makes the groups similar before treatment
    • 1 mark for explaining that confounding variables are spread across the groups by chance
    • 1 mark for concluding that a difference larger than chance would likely produce is attributed to the treatment
  4. 4.Describe[2 marks]

    Describe one advantage of a randomized block design over a completely randomized design.

    Show mark schemeHide mark scheme

    Model answer

    Units are sorted into blocks that are alike on a variable that affects the response. Treatments are compared within those blocks, so variation between blocks does not hide the treatment effect.

    • 1 mark for stating that units are grouped into blocks by a variable expected to affect the response
    • 1 mark for explaining that treatments are compared within similar units, removing variation between blocks
  5. 5.Justify[3 marks]

    A researcher compares two training plans using 40 runners, 20 beginners and 20 experienced. Justify blocking by experience level.

    Show mark schemeHide mark scheme

    Model answer

    Experience probably affects the response, such as running time. Blocking by experience compares the plans among runners who are alike. Random assignment within each block keeps the comparison fair.

    • 1 mark for stating that experience is expected to affect the response
    • 1 mark for explaining that blocking compares plans within similar runners and removes variation between blocks
    • 1 mark for mentioning random assignment of plans within each block

Practice this topic

10 quick-fire multiple-choice questions, easy to hard. Tap an answer to see if you're right and the worked explanation. (The written questions with mark schemes are under “Check your recall” above.)

0 right0 of 10 answered

Includes the 2 quick checks in the note above.

3.

Easy·Identify[1 mark]

Identify the best method for randomly assigning 20 subjects to two treatments.
Show answer and explanation

Answer: C · Worked explanation

Chance alone should decide the groups. Arrival order is a tempting shortcut, but early arrivals may differ from late ones in ways that affect the response. Choosing by preference or motivation lets subject characteristics steer the groups. A random generator gives every subject the same chance of each group.
4.

Medium·Identify[2 marks]

Researchers let 60 students decide whether to attend a tutoring program, then compare exam scores. Students who attend tend to be more motivated. Identify the role of motivation in this study.
Show answer and explanation

Answer: C · Worked explanation

Motivation is related to whether students attend and also affects exam scores, so its effect cannot be separated from the program’s. Researchers did not assign attendance, so motivation is not a treatment. Nobody sorted students by motivation, so it is not a block.
5.

Medium·Determine[2 marks]

A farmer tests two fertilizers on 24 plots. Twelve plots are on a slope and twelve are on flat ground, and slope affects yield. Determine the best design.
Show answer and explanation

Answer: A · Worked explanation

Slope is known to affect yield, so blocking by slope removes that variation from the comparison. Random assignment within blocks keeps the groups fair. Giving each fertilizer to one terrain type confounds fertilizer with slope. Ignoring slope would be valid but leaves avoidable variation.
6.

Medium·Calculate[2 marks]

A randomized block design uses two blocks of 30 subjects each. Within every block, subjects are randomly assigned in equal numbers to two treatments. Calculate how many subjects in each block receive the first treatment.
Show answer and explanation

Answer: B · Worked explanation

Each block of 30 subjects is split equally between two treatments, so 302=15\frac{30}{2}=15230​=15 subjects receive the first treatment. The value 30 comes from giving the whole block one treatment, and 60 counts every subject in the study. Equal splitting gives half of each block.
7.

Medium[2 marks]

Which statement about replication is correct?
Show answer and explanation

Answer: C · Worked explanation

More units per treatment make chance differences between individuals matter less in each group’s result. Replication cannot make groups identical or remove confounding, which control and random assignment address. Blinding deals with expectations, which more units cannot change. Replication only reduces chance variation.
8.

Medium·Identify[2 marks]

A teacher uses a new method in her morning class and the usual method in her afternoon class, then compares test scores. Identify the main flaw.
Show answer and explanation

Answer: C · Worked explanation

The method and the time of day change together, and morning and afternoon students may differ in alertness or ability. Randomly assigning students to methods would fix this. More students improve replication rather than weaken it, and a teaching method does not call for a placebo.
9.

Hard·Determine[2 marks]

From a list of all 800 members of a gym, researchers randomly select 100. They randomly assign 50 to a new workout plan and 50 to the usual plan. The new-plan group improves by more than chance would likely produce. Determine the best-supported conclusion.
Show answer and explanation

Answer: A · Worked explanation

Random assignment supports a cause-and-effect conclusion, and random selection from the whole gym supports generalizing to it. Random sampling does not weaken the causal claim, and blocking is optional. Limiting the claim to the 100 members ignores the random selection.
10.

Hard·Identify[2 marks]

In a drug trial, patients are randomly assigned to the drug or a placebo. The doctor who rates each patient’s improvement knows who received the drug. Identify the problem this creates.
Show answer and explanation

Answer: C · Worked explanation

Knowing who received the drug can bias how the doctor judges improvement, which is the problem blinding prevents. The assignment itself was random, so it remains valid. A placebo group is not a block, and replication depends on the number of patients rather than on what the doctor knows.

Keep going

Next topic2.1 Two categorical variables: tables and graphsPrevious topic1.12 Problems with sampling

More in Unit 1 · Exploring One-Variable Data and Collecting Data

  1. 1.5One quantitative variable: graphsNotes · 10 questions
  2. 1.6Describing a distributionNotes · 10 questions
  3. 1.7Summary statisticsNotes · 10 questions
  4. 1.8Boxplots and summary graphsNotes · 10 questions
  5. 1.9Comparing distributionsNotes · 10 questions
  6. 1.10Investigative questions and data collectionNotes · 10 questions
  7. 1.11Random samplingNotes · 10 questions
  8. 1.12Problems with samplingNotes · 10 questions
  9. 1.13Experimental designNotes · 10 questions

All AP Statistics topics →

Draft: written by Scribe and checked automatically, not yet by a subject reviewer.

Practice questions are original, written by Scribe and checked automatically for correctness.

Topic codes follow the official numbering. Not endorsed by College Board or any exam board.

On this page

0/6 read

  1. 1An experiment assigns treatments to study cause and effect
  2. 2Control keeps other influences from distorting the comparison
  3. 3Random assignment makes the treatment groups comparable
  4. 4Replication and blinding make the results more trustworthy
  5. 5Blocking separates a known source of variation
  6. 6Random assignment supports cause-and-effect conclusions
  7. Check your recall
  8. Practice: 10 questions
All coursesScribeHow it worksPricingPrivacyTerms

Notes and questions are written by Scribe in our own words. Topic codes follow the official course numbering so you can find your place. Not produced or endorsed by the IB, College Board, AQA, OCR, Pearson Edexcel or any exam board.

© 2026 Scribe