Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Can Participants Serve as Their Own Controls in a Research Study?

Participants can sometimes serve as their own controls, allowing researchers to compare outcomes within the same individuals. Learn when this approach is appropriate, what it controls for, and why time-related changes, carryover effects, and measurement decisions still matter.

171
Participants as Their Own Controls Guide 171 of 1272
01 · The Question

Can You Compare Participants With Themselves Instead of Recruiting a Separate Control Group?

Suppose you want to determine whether a new learning intervention improves students' performance. Rather than assigning one group to the intervention and another to a control condition, you measure the same students before and after they receive it.

Each student now has two observations. One represents performance before the intervention, and the other represents performance afterward. Does this mean the students have served as their own controls?

In a broad descriptive sense, yes. Their earlier observations provide a reference for their later outcomes. But whether this constitutes a credible controlled comparison depends on what the researcher wants to estimate and what might have changed between measurements.

The distinction matters because within-person comparisons can remove certain differences between participants while remaining vulnerable to changes over time, previous exposure, and other influences unrelated to the intervention.

02 · The Short Answer

Yes, but a Within-Person Comparison Is Not Automatically a Valid Causal Control

In Brief

Participants can serve as their own controls when their outcomes are compared across different conditions or observation periods. This approach can control for participant characteristics that remain constant, but it does not automatically control for changes over time, carryover effects, measurement reactivity, or other time-varying influences.

The design is most defensible when the relevant outcomes can be measured repeatedly, the intervention's effects and timing are compatible with within-person comparison, and important alternative explanations can be addressed. A simple before-and-after study, a randomized crossover trial, and a self-controlled observational design use this principle in different ways.

03 · What You Need to Know

How Participants Can Function as Their Own Comparison Group

What Does It Mean to Serve as Your Own Control?

In a conventional between-subjects comparison, outcomes are compared between different individuals or groups. In a within-person comparison, observations from the same individual under different conditions or periods are contrasted.

For example, a researcher might compare a participant's reaction time under two interface designs, blood pressure during different treatment periods, or writing performance before and after an instructional intervention.

The participant provides information about more than one condition. This reduces the need to estimate the comparison entirely from other individuals who may differ in important characteristics.

However, the participant cannot ordinarily experience both treatment conditions at exactly the same time under identical circumstances. The researcher must therefore consider whether differences in timing, sequence, and exposure could affect the outcome.

Which Research Designs Use Participants as Their Own Controls?

Several designs use within-person comparisons, but they differ in how the conditions are assigned, when outcomes are measured, and what causal assumptions are required.

Design How the Comparison Works Important Limitation
Single-group pretest-posttest Compares outcomes before and after an intervention in the same participants. Changes over time may occur without the intervention.
Within-subjects experiment Exposes participants to multiple experimental conditions and compares their responses. Order, learning, fatigue, and carryover may influence later responses.
Crossover trial Assigns participants to sequences of interventions across treatment periods. Residual treatment effects and period effects may compromise the comparison.
Case-crossover study Compares an individual's exposure during a period associated with an event against exposure during selected control periods. Exposure trends and selection of control periods may introduce bias.
Self-controlled case series Compares event incidence across exposure-defined periods within individuals who experience the event. Requires specific assumptions about observation, exposure, and event processes.

These designs should not be treated as interchangeable. In particular, an uncontrolled pretest-posttest comparison is not methodologically equivalent to a randomized crossover experiment simply because both collect repeated observations from the same people.

What Participant Differences Does Self-Control Remove?

Within-person comparisons can eliminate confounding from characteristics that remain constant across the relevant observation periods.

These might include relatively stable genetic characteristics, early-life experiences, or enduring individual attributes. In educational research, stable aspects of a student's prior preparation or background may be accounted for through within-person comparison, although knowledge and ability themselves can change.

Consider two students who differ substantially in baseline writing proficiency. If each student completes comparable tasks under two feedback conditions, a within-person analysis can focus on changes or differences within each student rather than relying entirely on comparisons between the two students.

This can improve statistical efficiency when repeated observations from the same participant are strongly correlated and the design's assumptions are satisfied.

Nevertheless, self-control does not eliminate time-varying confounding. Motivation, health, workload, practice, and exposure to other interventions may change between observations.

Why Is a Before-and-After Comparison Not Always Enough?

A pretest-posttest design compares outcomes measured before an intervention with outcomes measured afterward. The difficulty is that time and intervention exposure change together.

Suppose students improve their research-writing scores over a semester after using a new feedback platform. They may also have attended lectures, completed additional assignments, received faculty feedback, and gained experience through repeated practice.

The observed improvement cannot automatically be attributed to the platform.

Other threats include maturation, historical events, testing effects, changes in measurement instruments, and regression to the mean.

Researchers should therefore distinguish the descriptive question of whether participants changed from the causal question of whether the intervention produced that change.

How Does a Randomized Crossover Trial Strengthen the Comparison?

In a crossover trial, participants receive different treatments or conditions during separate periods, often in a randomized sequence.

For example, some participants may receive Treatment A followed by Treatment B, while others receive Treatment B followed by Treatment A.

Randomizing the sequence helps distribute certain period-related influences across treatment orders. Each participant contributes observations under both conditions, allowing treatment comparisons to account for stable participant differences.

However, randomization does not eliminate carryover, period effects, or treatment-by-period interactions. These must be considered during design and analysis.

Crossover designs are most suitable when the condition is sufficiently stable, outcomes respond within an appropriate period, and treatment effects are reversible or otherwise compatible with repeated treatment exposure.

When an intervention causes lasting learning or an irreversible physiological change, the limitations of crossover designs for irreversible interventions become especially important.

What Are Order Effects?

Order effects occur when a participant's response depends partly on the sequence in which conditions are experienced.

Practice is a common example. Participants may perform better during a second task because they have become familiar with the procedure, regardless of which experimental condition is presented.

Fatigue can produce the opposite pattern. Participants may respond more slowly or less accurately during later conditions because of sustained effort.

Expectations and adaptation can also influence responses.

Researchers may use randomization, counterbalancing of condition order, suitable rest intervals, or other design features to reduce or evaluate these effects.

The effectiveness of these strategies depends on the mechanism involved. Counterbalancing does not necessarily remove a persistent effect of the first intervention.

What Is a Carryover Effect?

A carryover effect occurs when exposure to an earlier condition continues to influence outcomes during a later condition.

For example, a participant who learns a new problem-solving strategy during the first experimental condition may continue using it during the second condition.

In pharmacological research, a treatment may remain biologically active after administration has stopped.

Carryover can distort the interpretation of treatment differences because outcomes during the second period may reflect both the current and previous interventions.

A washout period may reduce carryover when the effect dissipates over time. However, the appropriate washout duration depends on the intervention and outcome.

For learned skills, behavioral changes, or irreversible treatments, waiting may not restore the original condition.

Can Participants Serve as Their Own Controls Without an Intervention?

Yes. Some observational designs compare different exposure periods within the same individual.

A case-crossover study is particularly relevant when investigating whether a transient exposure is associated with an acute event. The individual's exposure during a period shortly before the event is compared with exposure during appropriately selected control periods.

A self-controlled case series examines event incidence during defined exposure periods and comparison periods among individuals who experienced the event.

These approaches can control for stable individual characteristics, but they have distinct assumptions. Exposure trends, age effects, event-dependent exposure, and event-dependent observation may threaten validity.

Researchers should select the specific self-controlled design according to the exposure process, outcome, and intended causal contrast rather than treating self-control as a complete research design in itself.

When Is a Within-Person Comparison Statistically Efficient?

Repeated observations from the same individual are often correlated. When that correlation is positive, comparing paired observations can reduce variability associated with stable differences between participants.

For two measurements, the variance of the within-person difference depends on the variability of each measurement and their covariance.

Variance of a Paired Difference
Var(Y₂ − Y₁) = Var(Y₂) + Var(Y₁) − 2Cov(Y₂, Y₁)
Y₁ and Y₂ represent two observations from the same participant. Var denotes variance, and Cov denotes covariance between the paired observations.
If both measurements have variance 100 and covariance 70, the variance of their difference is 100 + 100 − 140 = 60. This is smaller than the variance of 200 that would result if the two observations were independent with the same marginal variances.

The calculation illustrates why positive within-person correlation can improve precision. It does not imply that repeated-measures designs are always more efficient. Carryover, missing observations, additional study periods, and the chosen outcome model can offset or complicate this advantage.

How Should Repeated Observations Be Analyzed?

Because observations from the same participant are not independent, analysis should account for their within-person association.

For simple paired measurements, a paired-samples analysis may be appropriate when its assumptions are satisfied.

More complex designs may require repeated-measures models, mixed-effects models, generalized estimating equations, conditional regression, or methods tailored to specific self-controlled designs.

The appropriate analysis depends on the outcome distribution, number of periods, treatment assignment, missingness, and the scientific question.

Researchers should not analyze repeated observations as if each represented an independent participant. Doing so can produce incorrect standard errors and misleading inferences.

When Should Participants Not Serve as Their Own Controls?

Within-person control may be unsuitable when the intervention permanently changes the participant, the underlying condition changes rapidly or unpredictably, or repeated measurement substantially alters the outcome.

It may also be inappropriate when outcomes can occur only once, treatment sequences cannot be ethically assigned, or substantial dropout is expected between conditions.

For example, comparing a student's performance before and after completing an entire degree program does not create a reversible treatment comparison. The student cannot return to the same pre-program state to experience a genuinely alternative educational pathway.

In such situations, a parallel-group or other appropriately designed comparison may be more defensible.

04 · A Practical Example

Comparing Two Feedback Interfaces Within the Same Students

Hypothetical Example

A Randomized Within-Subjects Experiment

A university wants to compare two feedback interfaces used during short research-methods exercises. Interface A presents written feedback, while Interface B combines written feedback with visual annotations.

Forty students complete two comparable tasks. Half are randomly assigned to use Interface A first and Interface B second. The other half use the reverse sequence.

Task difficulty is balanced across conditions, and the researchers measure completion accuracy after each task.

Consider five illustrative participants from the study:

Student Interface A Score Interface B Score B − A
1 70 76 +6
2 78 82 +4
3 65 74 +9
4 83 85 +2
5 74 79 +5
Illustrative Calculation
Mean paired difference = (6 + 4 + 9 + 2 + 5) ÷ 5 = 5.2 points
Each difference is calculated as the student's score under Interface B minus the score under Interface A.
For these five illustrative students, scores are on average 5.2 points higher under Interface B. This calculation is descriptive and does not establish statistical significance or represent the complete 40-student study.

The design allows each student's response under Interface A to be compared with their response under Interface B. Stable differences in general academic ability are therefore less likely to distort the comparison.

However, the researchers still need to investigate whether task order, practice, fatigue, or learning from the first feedback interface influenced performance under the second.

They should analyze the complete sample using a method that accounts for pairing and relevant design factors. If the first interface teaches strategies that persist into the second task, the treatment contrast may be contaminated by carryover.

The central advantage is not simply that fewer participants may be required. It is that the design can estimate a within-person difference while controlling for stable participant characteristics, provided the conditions are sufficiently comparable and sequence effects are appropriately addressed.

05 · What Researchers Often Get Wrong

Misconceptions About Using Participants as Their Own Controls

Misconception

A Pretest Automatically Provides a Valid Control Condition

A pretest provides a baseline observation, but it does not establish what would have happened without the intervention. Maturation, history, practice, and other time-related influences may explain observed changes.

Misconception

Using the Same Participants Eliminates All Confounding

Within-person comparisons can control for stable individual characteristics. They remain vulnerable to time-varying confounders, period effects, and differences in measurement or exposure conditions.

Misconception

Every Intervention Can Be Tested in a Crossover Design

Interventions with persistent or irreversible effects may be unsuitable for crossover. The ability to expose participants to multiple conditions does not guarantee that those conditions can be compared independently.

Misconception

Counterbalancing Completely Removes Order Effects

Counterbalancing distributes sequence positions across participants, but it may not eliminate carryover, interactions between conditions, or effects that depend on previous learning.

Misconception

Repeated Observations Can Be Analyzed as Independent Data

Measurements from the same participant are generally correlated. Ignoring this dependence can distort standard errors and statistical inference.

Misconception

Within-Subjects Designs Always Need Smaller Samples

Potential efficiency gains depend on within-person correlation, treatment effects, design complexity, and missing data. Additional periods and carryover risks can reduce the practical advantage.

06 · What This Means for You

Deciding Whether Self-Control Is Appropriate for Your Research Question

Begin by identifying the outcome and asking whether it can be observed meaningfully under more than one condition within the same participant.

Then determine whether exposure to the first condition changes the participant in ways that could affect later observations. This question is particularly important in educational interventions because learning often persists beyond the period in which it occurs.

A simple decision framework

If conditions are reversible and outcomes can be measured repeatedly
Consider a randomized within-subjects or crossover design with appropriate sequence and period controls.
If you only have measurements before and after one intervention
Treat the comparison as a before-and-after design and assess alternative explanations for change.
If exposure is transient and the outcome is an acute event
Consider whether a case-crossover or another specialized self-controlled observational design fits the exposure and event process.
If the intervention produces lasting or irreversible effects
Consider a parallel-group or another design that does not require returning participants to an earlier state.

The broader decision between between-subjects and within-subjects comparisons should account for feasibility, causal validity, statistical efficiency, and the nature of the intervention.

Do not choose self-control solely because recruiting a separate comparison group is difficult. The design must still produce an interpretable contrast.

07 · A Quick Checklist

Before Using Participants as Their Own Controls, Check These Conditions

Before adopting a within-person comparison, check:
Specify the exact conditions or periods being compared and the intended causal or descriptive question.
Determine whether the outcome can be measured repeatedly without substantial measurement reactivity.
Evaluate whether intervention effects are reversible or persist into later conditions.
Identify potential practice, fatigue, order, and period effects.
Consider randomizing or counterbalancing treatment sequences when appropriate.
Assess time-varying confounders and changes in background conditions.
Plan for missing observations and participants who cannot complete every condition.
Use an analysis that accounts for repeated observations within participants.
Avoid claiming causality from simple pretest-posttest change without adequate justification.
08 · Frequently Asked Questions

Questions About Self-Controlled and Within-Subjects Designs

Is a pretest-posttest study a self-controlled design?

It uses a within-person comparison because participants are measured before and after an intervention. However, a single-group pretest-posttest design does not automatically provide a valid causal control for changes that would have occurred without the intervention.

Can participants serve as their own controls in a randomized trial?

Yes. Randomized crossover and other randomized within-subjects designs can assign the order of conditions while comparing outcomes within participants.

Does using the same participants eliminate selection bias?

It can reduce bias associated with stable differences between separate groups, but selection into the study, missing follow-up observations, and exposure-related selection processes may still threaten validity.

How many measurements are required for a within-person study?

At least two relevant observations are needed for a basic within-person comparison. More measurements or periods may be necessary to address trends, variability, intervention timing, or specific causal questions.

Can educational interventions use crossover designs?

Sometimes, particularly when comparing short-term, relatively reversible conditions such as interface layouts. Interventions that produce persistent learning may create carryover that makes crossover comparisons difficult to interpret.

Is a self-controlled case series the same as a crossover trial?

No. A self-controlled case series is an observational design that compares event incidence across exposure periods within cases. A crossover trial experimentally assigns intervention sequences and compares outcomes across treatment periods.

Can within-person comparisons establish causation?

They can support causal inference when the design and assumptions adequately address alternative explanations. Randomization, appropriate timing, control of period effects, and valid measurement can strengthen inference, but self-control alone is insufficient.

09 · The Bottom Line

Self-Control Removes Some Differences, Not Every Alternative Explanation

The Bottom Line

Participants can serve as their own controls when outcomes are compared across conditions or periods within the same individuals. This can control for stable participant characteristics and sometimes improve precision, but it does not automatically establish what would have happened without the intervention.

The design is most useful when repeated exposure is meaningful, carryover and time effects are manageable, and the analysis reflects the paired nature of the observations. Choose the specific self-controlled design according to the research question rather than treating repeated measurement as sufficient evidence of causal control.

10 · Sources and Further Reading

Authoritative References on Within-Person and Self-Controlled Designs

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes