Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

When Is Individual Randomization Preferable Despite Some Contamination Risk?

Some contamination risk does not automatically justify randomizing entire groups. Learn when individual randomization offers a more efficient and credible design, how to manage spillover, and when contamination becomes serious enough to reconsider the allocation unit.

210
Individual Randomization Despite Contamination Guide 210 of 1272
01 · The Question

Should You Abandon Individual Randomization Because Participants Might Share an Intervention?

You are evaluating an AI-supported writing tool among university students. Students can receive access through individual accounts, and the software records their usage. You plan to randomly assign students within the same courses to intervention and comparison conditions.

However, students regularly communicate with classmates. Some may discuss the tool, share generated feedback, or demonstrate its features to friends assigned to the comparison condition.

Would it be methodologically safer to randomize entire classes or universities instead?

Not necessarily. Some risk of contamination exists in many intervention studies. Changing to cluster randomization may reduce certain forms of spillover, but it also changes the statistical efficiency, recruitment requirements, and sometimes the causal question itself.

The relevant decision is whether the anticipated contamination is sufficiently consequential to justify abandoning individual allocation.

02 · The Short Answer

Prefer Individual Randomization When Contamination Is Limited or Manageable

In Brief

Individual randomization is generally preferable when an intervention can be delivered independently, contamination is expected to be limited or manageable, and spillover is unlikely to materially compromise the intended causal comparison. Under these conditions, individual allocation often provides greater statistical efficiency than randomizing intact groups.

The mere possibility that participants will communicate does not establish a need for cluster randomization. Researchers should examine how intervention exposure might spread, whether the resulting interference would affect the estimand, and whether feasible safeguards can preserve a meaningful contrast between assigned conditions.

03 · What You Need to Know

How to Decide Whether Individual Randomization Remains Defensible

Contamination risk is not an automatic reason to randomize groups

Contamination occurs when participants assigned to one condition receive elements of an intervention intended for another condition. It may involve shared materials, access to treatment resources, changes in provider behavior, or transmission of intervention-related knowledge.

Some degree of communication or interaction is common in educational, organizational, and community research. However, interaction alone does not establish that contamination is substantial.

For example, students may discuss an AI-supported writing application without obtaining access to the software or receiving the individualized feedback that constitutes the intervention.

The methodological concern is whether such interactions change the actual treatment contrast or influence outcomes through interference.

Researchers should distinguish plausible contamination pathways from speculative possibilities. The decision to adopt cluster allocation should be supported by an assessment of likely consequences rather than an assumption that any shared environment makes individual randomization invalid.

The circumstances in which contamination makes cluster randomization preferable depend on the mechanism, magnitude, and feasibility of preventing spillover.

Individual randomization usually offers greater statistical efficiency

When individuals are randomized independently within a setting, treatment allocation can vary among participants who share the same institutional environment.

This arrangement may allow comparisons within schools, clinics, or workplaces, reducing the influence of between-institution differences on the estimated treatment effect.

Cluster randomization instead assigns the same condition to everyone within an allocation unit. Participants within that unit may have correlated outcomes because they share organizational practices, resources, or contextual influences.

For a conventional equal-size parallel cluster-randomized design, a commonly used approximation to variance inflation is:

Approximate Cluster Design Effect
DE = 1 + (m − 1) × ICC
DE is the design effect; m is the number of participants per cluster; ICC is the intracluster correlation coefficient for the outcome under the assumed model.
If 50 students belong to each randomized classroom and the ICC is 0.05, DE = 1 + (50 − 1) × 0.05 = 3.45. Under the simplified comparison, classroom-level randomization produces approximately 3.45 times the variance of a comparable independent-observation design with the same total participant count.

This formula illustrates why cluster allocation can require more participants or clusters to achieve comparable precision.

It does not mean that an individually randomized study within classrooms can ignore classroom-level dependence. Students may still share outcome-related influences, and appropriate stratification, covariate adjustment, or variance estimation may be necessary.

Moreover, individual randomization can create treatment-group clustering when interventions are delivered by shared providers or in treatment groups. The analysis must reflect the actual dependence structure rather than assuming every observation is independent merely because allocation occurred individually.

The broader costs of cluster randomization should be weighed against the contamination it is expected to prevent.

When the intervention can be delivered independently

Individual randomization is particularly attractive when the intervention can be assigned, delivered, and monitored separately for each participant.

Examples include individual access to a digital learning platform, personalized feedback, individually administered counseling, or a treatment that does not require changing shared organizational practices.

In an educational technology trial, separate user accounts may allow researchers to control access to a learning application without changing how an entire classroom operates.

However, technical independence does not necessarily imply causal independence. Students may still share feedback, teachers may change their instruction in response to intervention users, or peer interactions may influence outcomes.

The intervention mechanism and the surrounding social environment should therefore be assessed together.

When contamination is unlikely to affect the primary outcome materially

Not every instance of spillover meaningfully changes the intervention contrast.

Suppose students assigned to an AI-supported feedback tool occasionally describe its interface to comparison students. If the intervention's active component is individualized feedback generated through sustained use, merely hearing about the interface may have little effect on writing performance.

By contrast, if the intervention consists primarily of teaching transferable writing strategies, students may communicate those strategies to comparison participants. The same interaction could then represent meaningful contamination.

Researchers should identify the intervention's active components and determine whether they can be transmitted through ordinary participant interactions.

Judgments about materiality should be based on plausible causal mechanisms, pilot evidence, or relevant prior studies rather than unsupported numerical thresholds.

Practical safeguards may reduce contamination without changing allocation

Several safeguards may be feasible when an intervention is delivered individually. Their suitability depends on the intervention and setting.

Potential safeguard Appropriate situation Important limitation
Individual access controls Digital interventions with separate user accounts Cannot prevent participants from sharing knowledge or outputs.
Separate intervention sessions Individually delivered training or counseling Participants may communicate outside the sessions.
Separate intervention providers Provider behavior could transfer treatment components May increase costs and introduce provider-related differences.
Standardized implementation protocols Providers deliver both intervention and comparison conditions Protocols do not guarantee that providers can maintain separation.
Exposure monitoring Intervention use or resource sharing can be documented Measurement does not itself prevent contamination.
Shorter exposure windows Intervention effects can plausibly be evaluated over a shorter period May change the substantive effect being estimated.

Safeguards should not substantially change the intervention being evaluated. For example, prohibiting ordinary student collaboration might prevent some contamination but create an artificial learning environment that differs from routine educational practice.

Researchers should consider whether contamination prevention itself introduces burdens, changes behavior, or reduces external validity.

Contamination and interference should be distinguished

Contamination involves exposure to intervention components across assigned conditions. Interference is broader: one participant's treatment assignment or exposure affects another participant's outcome.

For example, students receiving an intervention might improve the quality of group discussions, indirectly benefiting comparison students without directly sharing the intervention.

Such effects can complicate the interpretation of an individually randomized trial even when access controls prevent direct contamination.

The conventional no-interference assumption is often associated with the stable unit treatment value assumption. Its plausibility depends on the intervention and setting.

When indirect effects are central to the research question, researchers may need an alternative design or an estimand that explicitly accommodates interference.

Individual randomization can still estimate meaningful assignment effects under certain interference structures, but those effects may depend on the treatment allocation proportion and interaction environment.

Some contamination does not necessarily invalidate intention-to-treat analysis

Intention-to-treat analysis compares participants according to their randomized assignments, regardless of subsequent adherence or intervention receipt.

When contamination occurs, this analysis can still estimate the effect of assignment under the actual implementation conditions, subject to the study's assumptions and missing-data mechanisms.

However, the estimated effect may differ from the effect of receiving the intervention without spillover.

For example, an intervention assigned to selected students may produce a smaller contrast when comparison students obtain some of its benefits. The resulting intention-to-treat estimate may still be relevant to a policy question about offering the intervention under ordinary conditions.

Researchers should distinguish the effect of assignment from the effect of treatment receipt and avoid interpreting the former automatically as the latter.

Excluding participants who experienced contamination can introduce post-randomization selection bias. Supplementary exposure analyses require appropriate causal assumptions and should not replace the prespecified primary comparison without justification.

Why contamination does not always bias effects toward zero

It is tempting to assume that contamination simply makes intervention and comparison groups more similar, reducing the estimated treatment effect.

That may occur when comparison participants receive beneficial intervention components. However, spillover can have more complicated consequences.

Intervention participants might compete with comparison participants for shared resources, indirectly reducing comparison outcomes. Alternatively, changes in peer behavior might benefit both groups to different degrees.

The direction of the resulting difference depends on the causal mechanism and the intended estimand.

Researchers should not describe contamination as necessarily producing conservative estimates without establishing the assumptions required for that conclusion.

When group-level delivery does not require group-level randomization

An intervention may involve group sessions while still permitting individual randomization.

For example, participants may be randomized individually and then assigned to intervention-only training groups. Comparison participants may receive individual usual-care services or participate in separate comparison groups.

Such designs can create correlation among participants who receive treatment together. They may require analytical methods for individually randomized group-treatment trials or partially nested designs.

Thus, the presence of group-based delivery does not automatically mean that the groups must be the units of randomization.

The critical distinction is between how treatment is assigned and how treatment exposure or outcome dependence is structured.

When individual randomization becomes difficult to defend

Individual allocation becomes less attractive when intervention components are routinely transmitted across participants, when providers cannot realistically maintain separate conditions, or when the intervention changes shared organizational practices.

For example, a professional development intervention intended to transform whole-class teaching may be impossible to restrict to selected students within the same classroom.

Similarly, a school-wide policy or institutional learning management system configuration may affect all students regardless of individual assignment.

In such circumstances, randomizing intact groups may better preserve the intended intervention and comparison.

However, the chosen cluster level must still be justified, and the number of available clusters must be sufficient for the intended inference.

How to assess contamination before selecting the design

Researchers should identify the intervention's active components, likely communication pathways, shared providers, and organizational practices that could transmit exposure between trial arms.

Formative interviews, pilot studies, workflow observation, and prior research can help establish whether contamination is plausible and consequential.

For digital interventions, platform logs may help identify unauthorized access or shared use. However, access logs cannot capture every form of knowledge transfer or indirect influence.

Researchers should also consider whether the intervention's benefits are likely to spread through peer interactions even without direct access.

When uncertainty remains, design-stage sensitivity analyses can explore plausible contamination scenarios. Such analyses should be interpreted as conditional assessments rather than empirical proof of the amount of contamination that will occur.

Compare the expected information gained with the expected contamination avoided

The decision between individual and cluster randomization involves a trade-off.

Individual allocation may provide greater statistical efficiency and better control of shared institutional characteristics. Cluster allocation may reduce contamination or preserve group-level intervention delivery, but it generally requires more independent groups or participants.

The preferred design depends on whether the expected reduction in contamination justifies the loss of efficiency and additional operational requirements.

Guidance from the National Institutes of Health Research Methods Resources identifies low contamination risk as a circumstance favoring individual randomization, while substantial contamination risk supports consideration of group randomization.

Nevertheless, the threshold at which contamination becomes unacceptable is not universal. It depends on the intervention, estimand, and scientific consequences of spillover.

04 · A Practical Example

Choosing Individual Randomization for an AI Writing Intervention

Hypothetical Example

An individually delivered AI-supported feedback tool

A university researcher plans to evaluate an AI-supported writing feedback platform among 400 students enrolled in several academic writing courses.

Students can access the platform through individual accounts. The intervention provides personalized feedback on drafts, while comparison students continue receiving existing instructional support.

The researcher anticipates that students may discuss the platform or share selected feedback with classmates.

Identify the active intervention component. The primary treatment consists of individualized feedback generated through sustained platform use.
Assess possible contamination. Students may share examples of feedback, but comparison students cannot directly access the platform without assigned credentials.
Evaluate likely consequences. The team considers whether occasional sharing would substantially reproduce the intervention's active components or influence writing outcomes.
Introduce safeguards. Individual accounts, access monitoring, standardized instructions, and documentation of reported sharing are incorporated into the protocol.
Compare randomization options. Randomizing entire courses would reduce the number of allocation units and might introduce additional instructor-related differences.
Select and justify the design. The team retains individual randomization, with prespecified monitoring and analysis procedures, because substantial contamination is not expected under its planning assumptions.

Interpretation: Individual randomization is defensible because the intervention can be delivered separately and the anticipated spillover may be limited relative to the intervention's active components.

The decision does not depend on proving that contamination will be zero. It depends on a reasoned assessment that individual allocation can preserve a meaningful comparison more efficiently than randomizing entire courses.

If pilot evidence later indicates extensive sharing of personalized feedback or systematic changes in instructors' teaching practices, the researchers should reassess the design before proceeding with the definitive trial.

05 · What Researchers Often Get Wrong

Misconceptions About Individual Randomization and Contamination

Misconception

Any Contamination Makes Individual Randomization Invalid

Some contamination may occur without destroying the intended assignment comparison. The relevant issue is its magnitude, mechanism, and consequences for the estimand.

Misconception

Participants in the Same Classroom Must Be Randomized Together

Shared classroom membership does not automatically require cluster allocation. Individual randomization may be appropriate when the intervention can be delivered separately and interference is manageable.

Misconception

Digital Access Controls Eliminate All Spillover

Access restrictions may prevent unauthorized platform use, but participants can still share knowledge, outputs, or practices. Indirect effects may also occur without direct intervention access.

Misconception

Individual Randomization Means Outcomes Are Statistically Independent

Participants may share instructors, intervention providers, treatment groups, or institutional environments. The analysis must account for relevant dependence even when allocation occurs individually.

Misconception

Contamination Always Makes the Estimated Effect Smaller

Spillover may attenuate the treatment contrast, but indirect effects and resource competition can produce other patterns. Its consequences depend on the causal mechanism.

Misconception

Cluster Randomization Is Always More Rigorous Because It Prevents Sharing

Cluster allocation may reduce some contamination pathways, but it does not eliminate between-cluster spillover and can introduce substantial statistical and operational costs. Rigor depends on the suitability of the design, not the size of the randomization unit.

06 · What This Means for You

Retain Individual Allocation When It Preserves a Credible and Efficient Comparison

Begin by determining whether the intervention can be assigned and delivered independently. Then identify how contamination or interference could occur and whether those mechanisms would materially affect the primary outcome or intended estimand.

Evaluate safeguards that do not substantially change the intervention or research setting. If individual allocation remains credible, its statistical efficiency may provide a strong reason to retain it.

A practical randomization decision framework

If the intervention is individually delivered and spillover is limited
Prefer individual randomization when it can preserve the intended comparison.
If contamination can be reduced through feasible safeguards
Evaluate individual allocation with prospective contamination monitoring.
If shared providers create outcome dependence
Retain individual allocation where appropriate but use an analysis reflecting provider or treatment-group clustering.
If the intervention changes shared classroom or institutional practices
Consider cluster randomization because individual delivery may not preserve the intended intervention.
If substantial interference is central to the intervention
Consider an estimand and design that explicitly address direct and indirect effects.

The decision should be recorded in the protocol, including anticipated contamination mechanisms, preventive procedures, monitoring indicators, and the rationale for the selected allocation unit.

For educational technology research, distinguishing individual access to a tool from changes in shared instructional practice is especially important. The former may support individual randomization; the latter may require group-level allocation.

07 · A Quick Checklist

Before Retaining Individual Randomization Despite Contamination Risk

Before finalizing individual allocation, check:
Specify the intervention's active components and whether they can be delivered independently.
Identify plausible pathways for direct contamination and indirect interference.
Assess whether expected spillover could materially affect the primary outcome or estimand.
Evaluate feasible safeguards without substantially altering routine implementation.
Compare the statistical efficiency of individual and cluster allocation under defensible assumptions.
Identify any provider-level or treatment-group dependence requiring analytical adjustment.
Plan prospective measurement of intervention exposure and contamination.
Prespecify intention-to-treat analysis and any supplementary exposure analyses.
Document why individual randomization remains scientifically credible despite anticipated spillover.
08 · Frequently Asked Questions

Frequently Asked Questions About Individual Randomization and Spillover

Can students in the same class be individually randomized?

Yes. Individual allocation may be appropriate when the intervention can be delivered separately and contamination or interference is manageable. Shared classroom characteristics may still need to be considered in design and analysis.

Does any contamination invalidate an individually randomized trial?

No. The consequences depend on the amount and mechanism of contamination and the intended estimand. The randomized assignment comparison may remain meaningful even when some spillover occurs.

Is individual randomization always more powerful than cluster randomization?

It is often more statistically efficient for comparable designs when clustering creates positive outcome correlation, but the comparison depends on intervention delivery, covariance structure, analysis, and other design characteristics.

Can individually randomized participants receive treatment in groups?

Yes. Individually randomized group-treatment designs are possible. Group delivery may create correlated outcomes and require specialized analysis, but it does not automatically require group-level allocation.

Should participants who share intervention materials be excluded?

Not automatically. Excluding participants based on post-randomization exposure can introduce selection bias. Contamination should be documented, and supplementary analyses should use appropriate causal assumptions.

Can access restrictions make individual randomization acceptable for digital interventions?

They may reduce direct contamination, particularly when the intervention requires authenticated access. However, sharing of knowledge, feedback, or practices and indirect effects must still be considered.

When should contamination lead researchers to choose cluster randomization?

Cluster allocation becomes more defensible when substantial spillover is expected, cannot reasonably be controlled, and would compromise the intended individual-level comparison. The resulting cluster trial must also be feasible and adequately designed.

09 · The Bottom Line

Some Contamination Risk Is Compatible With Credible Individual Randomization

The Bottom Line

Individual randomization remains preferable when an intervention can be delivered separately, contamination is expected to be limited or manageable, and the resulting assignment comparison can answer the intended causal question with acceptable validity and greater statistical efficiency.

Do not replace individual allocation merely because participants might communicate. Assess the intervention's active components, plausible spillover mechanisms, preventive safeguards, and analytical requirements. Cluster randomization is justified when its methodological benefits outweigh its additional costs.

10 · Sources and Further Reading

Authoritative Sources on Contamination and Randomization Design

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes