Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

What Is a Carryover Effect in a Crossover Trial?

A carryover effect occurs when an earlier treatment continues to influence outcomes during a later treatment period. Learn how carryover threatens crossover comparisons, why it can be difficult to detect statistically, and which design decisions can reduce its influence.

185
Carryover Effects in Crossover Trials Guide 185 of 1272
01 · The Question

What Happens When the First Treatment Still Affects the Second Treatment Period?

Imagine a crossover trial comparing two interventions, A and B. Participants receive A during the first period, stop treatment, and then begin B.

But what if A continues to influence their responses after B has started?

The researcher may observe an outcome during the B period that reflects not only B but also the lingering consequences of A. The result could make B appear more effective, less effective, or more similar to A than it would otherwise appear.

This problem is called carryover. It is one of the most consequential threats to the interpretation of crossover trials because it challenges the assumption that outcomes under successive treatments can be compared meaningfully.

02 · The Short Answer

Carryover Occurs When an Earlier Treatment Influences a Later Treatment Period

In Brief

A carryover effect occurs when the influence of an intervention administered during one treatment period persists into a subsequent period and affects the outcome measured under the next intervention. In crossover trials, carryover can make the observed treatment difference depend on the order in which treatments were received.

Carryover may result from residual pharmacological activity, persistent biological changes, acquired knowledge, or behavioral adaptation. It should be distinguished from a general period effect, which concerns changes associated with time regardless of the preceding treatment. Washout intervals and suitable design choices may reduce carryover, but statistical tests alone cannot reliably establish its absence.

03 · What You Need to Know

How Carryover Arises and Why It Matters for Causal Interpretation

What Exactly Carries Over Between Treatment Periods?

Carryover concerns the continuing influence of a previous intervention after the participant has moved into another treatment period.

The earlier intervention itself may remain active, or its consequences may persist even after the intervention has ended.

For example, a drug may remain biologically active after administration stops. Alternatively, an intervention may produce a physiological adaptation that continues after the drug has been eliminated.

In behavioral or educational research, participants may retain strategies, knowledge, habits, or expectations acquired during the earlier condition.

The defining feature is that exposure history affects the outcome observed under the subsequent treatment.

How Does Carryover Appear in an AB/BA Crossover Trial?

Consider a randomized two-treatment, two-period crossover trial. Participants are assigned to either AB or BA.

Sequence Period 1 Period 2 Potential carryover
AB Treatment A Treatment B Residual influence of A during B.
BA Treatment B Treatment A Residual influence of B during A.

In the first period, participants have not yet received the other study treatment. In the second period, their responses may depend on both the current intervention and the previous one.

If the residual effects of A and B differ, the observed treatment contrast may vary according to the assigned sequence.

This is why randomized sequence allocation is necessary but not sufficient. Randomization determines who receives each order; it does not remove the biological or behavioral consequences of earlier exposure.

What Is the Difference Between Carryover and a Period Effect?

A period effect is an outcome difference associated with the measurement period rather than the current treatment.

Suppose participants perform better during the second period because they are more familiar with the testing environment. If this improvement occurs similarly regardless of the treatment sequence, it may be represented as a common period effect.

Carryover is different because the later response depends specifically on the treatment administered previously.

Period effect A systematic difference between measurement periods that is not attributable to the current treatment assignment.
Carryover effect A persistent influence of an earlier treatment on outcomes measured during a subsequent treatment period.

Both may occur in the same trial. Researchers must also consider treatment-by-period interactions, where the current treatment effect changes across periods for reasons that may not be reducible to a simple additive carryover term.

The broader problem of order-related influences in experiments includes these distinct mechanisms.

Can Carryover Be Positive or Negative?

Yes. Carryover may increase or decrease the outcome measured during a later period.

Suppose treatment A improves a participant's performance and some benefit persists during the B period. B may then appear more effective than it would have appeared without prior A exposure.

Alternatively, if A causes lingering fatigue or another unfavorable effect, performance under B may be worse.

The direction of bias depends on the treatment effects, residual effects, sequence allocation, and outcome scale.

Carryover is sometimes described as tending to reduce observed treatment differences in conventional crossover trials. That may occur under particular assumptions, but it is not a universal mathematical consequence. Differential carryover can bias an estimated contrast in either direction.

What Is First-Order Carryover?

First-order carryover refers to a model in which the outcome during a treatment period may depend on the treatment administered immediately before it.

For example, in a three-period sequence ABC, a first-order carryover model considers the influence of A on the B period and B on the C period.

It does not ordinarily include a direct residual influence of A on C after the intervening B period.

That restriction is an assumption about the persistence of earlier effects, not a guarantee that more distant exposure histories are irrelevant.

If an intervention produces effects that last across several subsequent periods, a first-order model may be inadequate.

Structured counterbalancing arrangements can balance selected immediate predecessor relationships, but they do not automatically remove the carryover effects themselves.

How Can Carryover Bias the Estimated Treatment Effect?

Consider a simplified two-period crossover model with additive treatment effects, a common period effect, and treatment-specific carryover affecting only the second period.

Let the direct treatment effects be represented by τA and τB, while λA and λB represent the residual effects of A and B.

For the AB sequence, the within-participant difference between the A and B periods includes the direct treatment contrast, the period effect, and residual A carryover.

For the BA sequence, the corresponding contrast includes the same direct treatment contrast, an oppositely signed period effect, and residual B carryover.

With equal sequence weighting, the common additive period effect cancels when the appropriately oriented contrasts are averaged.

Illustrative Additive Carryover Model
E(Estimated A − B contrast) = (τA − τB) + (λB − λA)/2

τA − τB is the direct treatment contrast. λA is the residual effect of A during the subsequent B period, and λB is the residual effect of B during the subsequent A period.

The expression assumes a balanced AB/BA design, additive effects, no carryover in the first period, and a common period effect that cancels under the specified contrast.

Suppose the direct A − B contrast is 4 outcome units, λA = 3, and λB = 1.

The expected observed contrast is 4 + (1 − 3)/2 = 3 units.

Under this simplified model, differential carryover reduces the observed contrast from 4 to 3 units. Reversing the relative carryover magnitudes could instead increase the observed contrast.

The calculation illustrates why the direction and magnitude of bias depend on differential residual effects. It does not imply that carryover parameters can be reliably estimated from an ordinary two-period crossover dataset.

Indeed, the difficulty of separating direct treatment effects from treatment-specific carryover is a central reason for evaluating carryover plausibility before the trial.

Does Equal Carryover From Both Treatments Cancel?

Under the simplified balanced additive model, equal carryover parameters produce no differential carryover term in the estimated A − B contrast.

However, this result depends on the model and estimand. Equal residual effects do not establish that participants have returned to their original states, and carryover may interact with current treatment or measurement period.

Researchers should therefore avoid treating equal carryover as a general justification for ignoring exposure history.

Can a Washout Period Prevent Carryover?

A washout period is an interval between treatment periods intended to allow residual effects to diminish.

It can be useful when intervention effects are temporary and their duration can be reasonably established.

For example, a pharmacological crossover trial may consider elimination kinetics and the persistence of biological effects when determining the interval between treatments.

However, drug elimination and disappearance of treatment effects are not always equivalent. A biological response may persist after the administered substance is no longer present at an appreciable concentration.

In educational research, a waiting period cannot reliably eliminate knowledge acquired during an earlier intervention.

The appropriate question is therefore not simply how long participants should wait, but whether the residual influence of the first treatment is sufficiently negligible when the subsequent outcome is measured.

Determining an appropriate washout duration requires evidence about the intervention and outcome rather than an arbitrary interval.

Can Researchers Detect Carryover With a Statistical Test?

Statistical tests for carryover have been proposed, but their interpretation is difficult, particularly in conventional two-period crossover trials.

A nonsignificant test does not establish that carryover is absent. Limited statistical power may prevent detection of effects that are substantively important.

Furthermore, carryover parameters may be difficult to distinguish from sequence-related differences without additional assumptions.

Using a preliminary carryover test to decide whether to analyze both periods or only the first can introduce additional inferential problems.

Watch Out

Do not use a nonsignificant carryover test as proof that a crossover trial is valid. Assess plausible residual effects using substantive knowledge, previous evidence, treatment timing, and the intended outcome before data collection.

The Cochrane Handbook identifies carryover as a principal concern when assessing bias in crossover trials and cautions against selecting first-period analyses on the basis of a preliminary carryover test.

How Can Carryover Be Investigated Without Relying on One Significance Test?

Researchers can examine several sources of evidence when evaluating possible carryover.

Prior studies may provide information about how long an intervention remains active. Pharmacokinetic or pharmacodynamic evidence may be relevant for medicines, while learning-retention evidence may be more appropriate for educational interventions.

Repeated measurements during washout may help characterize the return toward baseline when the outcome can be measured safely and meaningfully.

Descriptive outcomes by treatment, sequence, and period may also reveal patterns requiring explanation.

However, none of these observations automatically identifies the causal contribution of carryover. Their interpretation depends on measurement reliability, the underlying time course, and the assumptions of the design.

When residual effects remain plausible, researchers should examine how the conclusions depend on those assumptions and report the uncertainty transparently.

When Does Carryover Make a Crossover Trial Inappropriate?

Carryover becomes a fundamental design problem when earlier interventions produce persistent effects that cannot be sufficiently reduced before later outcome measurement.

This is particularly relevant to irreversible interventions, durable learning, permanent physiological changes, and outcomes that cannot meaningfully recur under different treatment conditions.

If the underlying condition also changes substantially across periods, distinguishing current treatment effects from exposure history may become even more difficult.

In such circumstances, the assumptions required for a conventional crossover trial may not be defensible.

A parallel-group trial may then provide a clearer comparison because participants are not required to receive both interventions sequentially.

04 · A Practical Example

How Residual Learning Can Distort a Crossover Comparison

Hypothetical Example

Comparing Two Research Article Evaluation Tools

A researcher compares two digital tools for identifying methodological weaknesses in published studies.

Tool A provides detailed explanations of methodological errors. Tool B provides brief diagnostic prompts.

Participants are randomly assigned to use A then B or B then A. Their accuracy in identifying methodological weaknesses is measured after each period.

Step 1: Identify the intended comparison

The researcher wants to estimate which tool produces better immediate evaluation accuracy when used independently.

Step 2: Recognize a plausible carryover mechanism

Participants using Tool A may learn methodological concepts from its detailed explanations. They may retain this knowledge when subsequently using Tool B.

Step 3: Examine hypothetical outcomes

Suppose the mean accuracy percentages are:

Sequence Period 1 Period 2
AB A = 78% B = 82%
BA B = 68% A = 80%
Step 4: Calculate descriptive treatment means

With equal numbers of participants in each sequence, the overall mean for A is (78 + 80)/2 = 79%.

The overall mean for B is (82 + 68)/2 = 75%.

The descriptive contrast favors A by 4 percentage points.

Step 5: Examine the exposure-history pattern

Tool B receives a mean accuracy score of 82% when used after A but 68% when used first. This difference is consistent with possible learning transfer from A, although period effects, task differences, and other explanations remain possible.

Step 6: Reconsider the estimand

If the objective is to compare independent first-use performance, the crossover average may not answer the intended question. A parallel-group design assigning participants to one tool may be more appropriate.

The example does not establish that carryover occurred. The observed sequence pattern is compatible with several explanations, and the hypothetical means alone cannot isolate the residual effect of Tool A.

Its methodological lesson is that treatment responses may depend on prior exposure. Researchers should establish whether this dependency is part of the research question or a threat to the intended comparison.

05 · What Researchers Often Get Wrong

Common Misconceptions About Carryover Effects

Misconception

Does Carryover Mean the Previous Treatment Is Still Being Administered?

No. Carryover can persist after treatment administration ends. The intervention's biological, cognitive, or behavioral consequences may continue even when the original treatment is no longer present.

Misconception

Is Carryover the Same as a Period Effect?

No. A period effect concerns changes associated with measurement time, whereas carryover concerns the influence of a preceding treatment. Both may contribute to later outcomes.

Misconception

Does Counterbalancing Eliminate Carryover?

No. Counterbalancing distributes treatment sequences or selected predecessor relationships. It does not erase residual intervention effects.

Misconception

Does Carryover Always Bias Treatment Effects Toward Zero?

No. Bias direction depends on the residual effects of each treatment, the outcome scale, and the design assumptions. Differential carryover can increase or decrease the estimated treatment contrast.

Misconception

Can a Nonsignificant Carryover Test Establish No Carryover?

No. A nonsignificant result may reflect insufficient power or limitations of the model. It cannot establish that residual effects are absent or negligible.

Misconception

Does a Washout Period Guarantee Independent Treatment Responses?

No. Washout may reduce temporary effects, but it cannot reliably eliminate permanent changes or durable learning. Its adequacy must be justified for the intervention and outcome.

06 · What This Means for You

How to Address Carryover Before and During a Trial

The strongest response to carryover begins before data collection. Researchers should identify plausible mechanisms through which the first intervention might influence later outcomes.

Next, they should assess how long those effects may persist and whether the study can reasonably allow them to diminish before subsequent measurements.

A simple decision framework

If intervention effects are temporary and their duration is reasonably established
Consider a crossover design with appropriately justified treatment timing and washout where needed.
If residual effects are plausible but poorly characterized
Seek stronger prior evidence, consider pilot measurements, or evaluate a design less dependent on negligible carryover.
If earlier interventions produce lasting learning or irreversible changes
Prefer a design that does not require participants to return to their original state for the intended comparison.
If carryover may vary by treatment
Consider how differential residual effects could influence the estimand and whether the design can support a credible interpretation.
If outcomes suggest sequence-dependent responses
Examine treatment-by-period summaries and report plausible alternative explanations without claiming that carryover has been isolated.

For randomized crossover trials, the protocol should prespecify treatment sequences, washout rationale, outcome measurement timing, and the primary analysis.

The final report should present sufficient information about treatment periods and sequences for readers to evaluate the plausibility of carryover and the robustness of the interpretation.

Researchers should not treat the absence of a statistically significant carryover test as a substitute for substantive justification.

07 · A Quick Checklist

Before Assuming Carryover Is Negligible

Before finalizing the crossover comparison, check:
Identify the mechanisms through which each intervention could influence later treatment periods.
Review evidence about the persistence of intervention effects rather than relying only on treatment discontinuation.
Determine whether residual effects could differ between treatments.
Distinguish carryover from common period effects and treatment-by-period interactions.
Justify any washout interval using the intervention mechanism and relevant outcome.
Evaluate whether the selected sequence arrangement addresses anticipated order-related influences.
Avoid relying on a nonsignificant carryover test to establish design validity.
Prespecify the primary treatment contrast and analysis before examining outcomes.
Consider a parallel-group design if residual effects cannot be made sufficiently negligible.
08 · Frequently Asked Questions

Frequently Asked Questions About Carryover Effects

What is a carryover effect in a crossover trial?

A carryover effect occurs when an earlier treatment continues to influence outcomes measured during a later treatment period. It can make the observed response depend on treatment history as well as the current intervention.

What is an example of carryover in educational research?

Students may learn a problem-solving strategy during the first instructional condition and continue using it during the second. Their later performance then reflects both the current instruction and knowledge acquired earlier.

Can carryover occur even after treatment has stopped?

Yes. The intervention itself may remain active, or its effects may persist after administration ends. Biological adaptation, learned knowledge, and behavioral changes can continue into subsequent periods.

Does carryover always make a crossover trial invalid?

Not necessarily. Its importance depends on the estimand, magnitude, direction, and assumptions of the design. Substantial differential carryover may undermine a conventional treatment contrast, while sufficiently negligible residual effects may be acceptable.

How is carryover different from an order effect?

Carryover is a specific form of sequence dependence caused by an earlier treatment's persistent influence. Order effects also include practice, fatigue, context, and other changes associated with presentation sequence or position.

Can a statistical test prove that carryover is absent?

No. A nonsignificant test does not establish absence, and carryover may be difficult to identify separately from other sequence-related effects. Substantive evidence and design-stage justification are essential.

Can a washout period eliminate carryover?

A justified washout may reduce temporary residual effects to a sufficiently negligible level. It cannot guarantee elimination of persistent biological changes or durable learning.

What should researchers do if carryover cannot be avoided?

They should reconsider whether the intended treatment effect can be estimated using a crossover design. A parallel-group trial or a study explicitly focused on intervention sequences may be more appropriate.

09 · The Bottom Line

Carryover Makes Treatment History Part of the Outcome

The Bottom Line

A carryover effect occurs when an earlier intervention continues to influence outcomes during a later treatment period. It can distort crossover treatment comparisons by making observed responses depend on previous exposure as well as the current treatment.

Researchers should assess plausible carryover mechanisms before the trial, justify treatment timing and washout where appropriate, and avoid treating nonsignificant carryover tests as proof of absence. When residual effects cannot be made sufficiently negligible, a different design may provide a more defensible estimate.

10 · Sources and Further Reading

Authoritative Sources on Carryover and Crossover Trial Validity

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes