Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Should Observational Causal Studies Be Designed Around a Hypothetical Target Trial?

Designing an observational causal study around a hypothetical randomized trial can clarify the causal question and expose avoidable biases. Learn how to specify eligibility, treatment strategies, assignment, follow-up, outcomes, and analysis before using observational data, and when the target trial framework is most useful.

363
Designing Observational Studies Around a Target Trial Guide 363 of 1272
01 · The Question

Should You Design an Observational Study as Though You Were Planning a Randomized Trial?

You want to determine whether sustained use of an AI-supported feedback system improves university students' writing performance.

Random assignment is not feasible because the system has already been introduced institution-wide. However, the university has administrative records showing when students began using the system, how frequently they accessed it, and their subsequent academic performance.

You could classify students as frequent users and infrequent users, compare their final writing scores, and adjust for measured differences.

But this approach raises several questions. When did follow-up begin? Were students eligible for both exposure strategies at that time? Were frequent users identified using information collected after the study period had already begun? Could students' earlier performance have influenced their subsequent usage?

These problems suggest that observational causal research may benefit from defining the randomized experiment the researcher would ideally conduct before examining the available data.

02 · The Short Answer

A Hypothetical Target Trial Is Often a Useful Starting Point for Observational Causal Research

In Brief

Yes. When an observational study seeks to estimate the causal effect of a well-defined intervention or treatment strategy, specifying a hypothetical target trial can help clarify the causal question, align eligibility and follow-up, define meaningful treatment alternatives, and identify biases that might otherwise remain hidden.

The approach does not make observational data equivalent to randomized evidence. It requires researchers to explain how the available data approximate the target trial and which identification assumptions remain necessary. The framework is especially useful for longitudinal treatment decisions, but it is not automatically the most appropriate structure for every descriptive, exploratory, or observational research question.

03 · What You Need to Know

Using a Hypothetical Target Trial to Structure Observational Causal Research

What Is a Hypothetical Target Trial?

A target trial is the randomized experiment that would ideally answer a specified causal question.

It defines the population, treatment strategies, assignment procedures, follow-up, outcomes, causal effect, and analysis before the researcher attempts to estimate the effect using observational evidence.

For example, a target trial might randomly assign eligible students at the beginning of a semester to receive a structured AI feedback intervention or conventional feedback.

The researcher would then measure writing performance after a specified period.

When such a trial cannot be conducted, its protocol can serve as a reference for designing an observational analysis.

Hernán and Robins (2016) describe how explicitly emulating a target trial can help avoid methodological problems in observational causal research.

Why Begin With a Trial That Will Not Actually Be Conducted?

Observational datasets are often organized according to administrative convenience rather than causal research requirements.

Records may contain exposure histories, outcomes, and participant characteristics without clearly defining when participants became eligible or when treatment strategies began.

Beginning with the hypothetical trial forces researchers to specify the intended intervention and comparison before selecting records or constructing exposure categories.

This can reveal whether the available data support the causal question.

It also makes design decisions more transparent, particularly when exposure and eligibility change over time.

The purpose is not to pretend randomization occurred. It is to make the observational design correspond as closely as possible to a coherent causal experiment while identifying differences that remain.

What Components Should a Target Trial Specify?

Protocol component Question to specify Educational example
Eligibility criteria Who can enter the study, and when? Students enrolled in a defined writing course at semester start.
Treatment strategies What intervention alternatives are compared? Structured AI feedback versus conventional feedback.
Assignment How would eligible participants be allocated? Hypothetical random assignment to feedback strategies.
Time zero When do eligibility, assignment, and follow-up begin? The beginning of the instructional period.
Follow-up How long are outcomes observed? One academic semester.
Outcome What result is measured and when? Writing performance on a standardized final assessment.
Causal estimand What effect is the study intended to estimate? Effect of assignment to the feedback strategy among eligible students.
Analysis plan How would the target effect be estimated? Specified comparison and appropriate uncertainty estimation.

These components should be coherent with one another. A treatment strategy that begins after the defined follow-up period, for example, cannot answer the intended causal question.

Why Are Eligibility Criteria Important?

Eligibility criteria define the population to which the target causal effect applies.

For example, a study may include students who are enrolled in a writing course, have not yet received the intervention, and are eligible for either feedback strategy at the beginning of the semester.

These conditions should be determined using information available at the relevant eligibility time.

If researchers select participants according to events that occur later, the resulting sample may be affected by post-baseline selection.

Eligibility should therefore be specified before exposure histories and outcomes are analyzed.

What Are Treatment Strategies?

Treatment strategies describe the interventions whose causal effects are being compared.

For example, one strategy might involve offering students access to a structured AI feedback system, while another provides conventional teacher feedback.

A different question might compare sustained weekly use of AI feedback with no AI feedback use throughout the semester.

These strategies are not equivalent.

The first concerns assignment or access, while the second concerns sustained behavior that may depend on evolving student characteristics.

Researchers should define treatment strategies precisely enough that the relevant potential outcomes are meaningful.

Ambiguous categories such as AI users and nonusers may conceal multiple intervention versions.

What Is Time Zero?

Time zero is the beginning of follow-up for the causal comparison, aligned with eligibility and the assignment or initiation of the treatment strategies.

For example, if the target trial would assign students to feedback strategies at the beginning of the semester, follow-up should begin at that corresponding point.

Defining time zero consistently helps prevent differences in the opportunity to experience outcomes.

It also prevents researchers from classifying participants according to future exposure information without accounting for the period needed to acquire that classification.

Time-zero alignment is one of the most consequential contributions of the target trial framework.

What Is Immortal Time Bias?

Immortal time bias can arise when a period during which a participant must remain event-free or under observation to qualify for an exposure category is handled incorrectly.

Suppose researchers classify students as sustained AI users only if they complete at least ten weeks of system use.

Students must remain enrolled and observed long enough to satisfy that definition.

If follow-up begins at semester start but sustained users are identified using later information, the comparison may give that group a structurally different opportunity to experience the outcome or withdrawal event.

Appropriate treatment strategies, time alignment, and analytical methods are needed to avoid this problem.

Hernán and colleagues (2016) emphasize how specifying the target trial can reveal biases arising from inappropriate time-related design decisions.

Why Should Eligibility, Assignment, and Follow-Up Be Aligned?

These events should correspond to the same meaningful starting point in the causal design.

If one group begins follow-up when treatment starts while another begins months earlier, differences may arise from unequal observation periods rather than treatment effects.

Similarly, using future information to define eligibility may create selection bias.

Researchers should specify when participants become eligible, when intervention strategies are assigned or initiated, and when outcomes begin to be observed.

The observational analysis should then approximate this structure as closely as the available data permit.

Does a Target Trial Require Actual Randomization?

No. The hypothetical target trial specifies random assignment as part of the ideal experiment, but the observational study does not claim that randomization occurred.

Instead, the researcher attempts to estimate the target effect using nonrandomized exposure information.

This requires assumptions about treatment selection and potential outcomes.

Conditional exchangeability, positivity, and consistency are particularly relevant in many observational causal analyses.

The target trial framework clarifies these assumptions rather than eliminating them.

What Is the Difference Between a Target Trial and Target Trial Emulation?

A target trial is the hypothetical randomized experiment defining the causal question.

Target trial emulation is the process of designing and analyzing observational data to approximate that trial's protocol.

For example, the researcher may specify an ideal randomized comparison at semester start and then identify observational records that satisfy corresponding eligibility, treatment, and follow-up definitions.

The distinction matters because specifying a hypothetical trial is a conceptual design step, while emulation requires operational decisions about real data.

The detailed procedures of target trial emulation depend on the treatment strategies, available information, and causal estimand.

What Is the Role of Conditional Exchangeability?

Conditional exchangeability requires that the observational comparison adequately account for common causes of treatment and outcome through an appropriate covariate set.

For example, students' prior writing ability, digital access, and motivation may influence both AI feedback adoption and later performance.

If important confounders are unmeasured, the observational estimate may remain biased.

Specifying the target trial helps identify what should have been measured before treatment assignment.

However, the framework cannot recover variables that were never recorded.

Researchers should distinguish a clearly specified target trial from a successfully identified causal effect.

Why Is Positivity Important?

Positivity requires that the treatment strategies being compared are possible across relevant covariate profiles in the target population.

Suppose students without reliable internet access cannot realistically use the AI feedback system.

The available data may contain no comparable exposed observations for those students.

Estimating the effect of sustained AI use for that subgroup may therefore require unsupported extrapolation.

Researchers may need to revise eligibility criteria, redefine the intervention, or restrict the target population.

The hypothetical trial should describe a comparison that is meaningful and feasible for the population under consideration.

What Is Consistency in a Target Trial Framework?

Consistency connects observed outcomes with the potential outcomes under the treatment strategies actually followed.

For example, if AI-supported feedback includes several substantially different forms of use, a single exposure label may not correspond to one well-defined intervention strategy.

Researchers should specify the intervention sufficiently clearly to support interpretation.

However, treatment strategies may legitimately include flexible or adaptive components when these are explicitly defined.

The important issue is whether the exposure definition corresponds to a meaningful causal intervention.

What Is the Difference Between an Assignment Effect and a Per-Protocol Effect?

An assignment effect concerns outcomes under alternative treatment assignments or offers.

A per-protocol effect concerns outcomes under specified adherence to intervention strategies.

For example, offering access to AI feedback may have a different effect from ensuring sustained use throughout the semester.

The observational data requirements and identifying assumptions may differ substantially between these questions.

Researchers should define the estimand before constructing exposure groups.

Hernán and Robins (2017) discuss the distinction between intention-to-treat and per-protocol effects and the challenges of estimating adherence-related causal effects.

Can a Target Trial Framework Address Time-Varying Treatments?

Yes. It can clarify intervention strategies that change over time.

For example, a strategy may require students to complete a specified feedback activity each week rather than simply use the system at least once.

However, treatment decisions may depend on evolving performance, confidence, or workload.

Some of these characteristics may be affected by earlier treatment.

Conventional adjustment may be inadequate when time-varying confounders are also consequences of previous exposure.

Appropriate longitudinal causal methods may be needed under defensible assumptions.

The target trial framework clarifies the question but does not automatically determine the correct estimator.

Can the Same Participant Enter Multiple Target Trials?

In some longitudinal observational settings, researchers may emulate a sequence of trials beginning at different eligible time points.

For example, students may become eligible to initiate a feedback intervention at several points during an academic program.

Each eligible time may define a separate trial-like comparison under a specified protocol.

However, repeated eligibility creates dependencies because the same participant may contribute to multiple emulated trials.

Analyses must account appropriately for this structure.

Sequential trial emulation is not necessary for every study, but it can be useful when treatment initiation decisions occur repeatedly.

What If Treatment Strategies Cannot Be Distinguished in the Available Data?

The observational dataset may not contain sufficient information to identify the intended intervention conditions.

For example, platform records may show login frequency without indicating whether students received meaningful feedback or applied it to revisions.

If the target trial concerns sustained formative feedback engagement, login counts may be an inadequate exposure measure.

Researchers should evaluate whether the available records support the intervention definition.

Where they do not, the causal question may need to be revised or additional data collected.

The target trial framework is valuable partly because it exposes such limitations before researchers interpret an association as a treatment effect.

When Is the Target Trial Framework Particularly Useful?

It is especially useful when researchers investigate well-defined interventions using longitudinal observational data.

Examples include treatment initiation, sustained intervention use, switching between strategies, and policy implementation with clearly defined eligibility and follow-up.

The framework may also help clarify comparisons involving institutional interventions when the causal contrast can be specified coherently.

However, the approach should not be applied mechanically to every observational study.

A descriptive survey estimating AI use prevalence does not require a hypothetical randomized trial because its objective is not causal intervention estimation.

Likewise, an exploratory qualitative study may investigate experiences without defining treatment strategies or potential outcomes.

Can a Target Trial Be Designed Around an Impossible Intervention?

A hypothetical trial should represent a sufficiently well-defined and meaningful intervention contrast.

For example, randomly assigning students to receive structured feedback is conceptually clearer than assigning them to possess an unspecified level of motivation.

Some exposures cannot be directly manipulated in the way a treatment can, and causal questions involving them require additional conceptual care.

Researchers should distinguish an intervention on a modifiable process from an ill-defined attempt to manipulate a fixed characteristic.

The target trial should clarify the intervention rather than conceal ambiguity behind experimental terminology.

Does Target Trial Emulation Eliminate Confounding?

No. Emulation improves design clarity and may prevent avoidable biases, but it does not reproduce random assignment.

Students who initiate AI feedback may differ systematically from those who do not.

Appropriate adjustment may address selected measured confounding under suitable assumptions, but unmeasured confounding may remain.

The question of whether adjustment establishes causation therefore remains central.

Researchers should not describe an observational study as randomized merely because it was organized according to a target trial protocol.

How Does Target Trial Design Relate to Alternative Explanations?

Specifying a hypothetical trial can reveal how an observational comparison might be biased.

For example, defining exposure groups using future usage information may introduce time-related selection bias.

Allowing different eligibility dates across groups may create unequal follow-up.

Omitting baseline achievement may leave important confounding unaddressed.

Researchers should use the target trial protocol to identify where the observational analysis departs from the ideal experiment and which assumptions are needed to justify those departures.

The broader principle of designing causal studies around alternative explanations is therefore closely related to target trial specification.

What Should Be Reported in an Observational Target Trial Study?

Researchers should describe the hypothetical target trial and explain how each protocol component was implemented using observational data.

Eligibility criteria, treatment strategies, time zero, follow-up, outcomes, estimands, and analytical procedures should be explicit.

Departures from the hypothetical randomized trial should be identified.

The methodology should justify confounder selection, explain exposure measurement, and evaluate relevant positivity, consistency, and missing-data assumptions.

Researchers should distinguish the design specification from evidence that the causal effect has been identified successfully.

Transparency is particularly important when the available data were collected for administrative purposes rather than the causal question being investigated.

Watch Out

Do not assume that calling an observational analysis a target trial emulation makes it equivalent to a randomized trial. The framework improves causal question specification and design alignment, but the resulting estimate still depends on observational identification assumptions and the quality of available data.

04 · A Practical Example

Designing an Observational AI Feedback Study Around a Hypothetical Trial

Hypothetical Example

Evaluating a University-Wide AI Feedback System After Implementation

A university has introduced an AI-supported feedback platform across its undergraduate writing courses. Random assignment is no longer feasible, but administrative data include student enrollment, baseline writing scores, platform activity, and final assessment results.

Step 1: Specify the hypothetical trialDefine eligible students, the beginning of the semester, the intervention strategies, outcome, follow-up, and intended causal effect.
Step 2: Define treatment strategiesCompare clearly specified feedback-use strategies rather than loosely defined categories such as frequent users and infrequent users.
Step 3: Align time zeroEnsure eligibility and follow-up begin at the corresponding point for all participants.
Step 4: Avoid future-defined baseline groupsDo not classify students as sustained users using later behavior and then treat that classification as though it were assigned at semester start.
Step 5: Identify confoundingMeasure relevant pre-exposure characteristics, including prior writing ability and other plausible determinants of intervention use and outcomes.
Step 6: Evaluate data adequacyDetermine whether exposure histories, outcomes, and relevant confounders are sufficiently measured and whether overlap supports the intended comparison.
Step 7: Estimate and interpretUse an analysis aligned with the target estimand and explain the assumptions required for causal interpretation.

Suppose the observational analysis estimates higher writing performance under a sustained AI feedback strategy.

The target trial framework clarifies what the estimate is intended to represent and helps prevent errors in eligibility and follow-up alignment.

However, the result remains dependent on whether the observational comparison adequately addresses treatment selection, time-varying confounding, measurement, and other relevant assumptions.

The contribution of the framework is not that it guarantees a causal answer, but that it makes the causal question and its limitations more explicit.

05 · What Researchers Often Get Wrong

Common Misconceptions About Hypothetical Target Trials

Misconception

Does Target Trial Emulation Mean the Study Was Randomized?

No. The observational study approximates a specified randomized trial but does not reproduce random assignment.

Misconception

Can Any Observational Dataset Support a Target Trial?

No. The data must contain adequate information about eligibility, treatment strategies, timing, outcomes, and relevant confounders.

Misconception

Does Defining Time Zero Eliminate Every Bias?

No. Time alignment can prevent particular biases, but confounding, selection, measurement, and other problems may remain.

Misconception

Can Researchers Define Treatment Groups Using Future Exposure Without Consequences?

Not automatically. Future-defined categories can introduce time-related selection problems and require appropriate strategy definitions and analysis.

Misconception

Does Statistical Adjustment Complete the Emulation?

No. Adjustment is only one part of a design requiring coherent eligibility, treatment, follow-up, measurement, and identification assumptions.

Misconception

Should Every Observational Study Emulate a Randomized Trial?

No. The framework is particularly useful for well-defined causal intervention questions, not necessarily for descriptive or exploratory objectives.

06 · What This Means for You

How to Decide Whether a Hypothetical Target Trial Fits Your Research Question

Begin by determining whether your objective concerns the causal effect of a meaningful intervention strategy.

If it does, specify the randomized trial that would ideally answer the question before constructing the observational comparison.

A simple decision framework

If the question concerns a well-defined intervention effect
Specify a hypothetical target trial before selecting observational exposure groups.
If treatment begins at different times
Align eligibility, time zero, treatment strategies, and follow-up carefully.
If exposure varies throughout follow-up
Define longitudinal strategies and evaluate whether methods addressing time-varying confounding are needed.
If important trial components cannot be reconstructed
Revise the question, obtain additional data, or acknowledge that the intended effect cannot be identified credibly.
If the objective is descriptive rather than causal
Use a design appropriate to description without imposing unnecessary hypothetical intervention strategies.

The target trial should clarify the causal question and expose design limitations before the researcher interprets observational associations as intervention effects.

07 · A Quick Checklist

Check Whether Your Observational Study Has a Defensible Target Trial

Before analyzing observational causal data, check:
Specify the causal intervention question and target population.
Define eligibility using information available at the appropriate time.
Describe meaningful and sufficiently well-defined treatment strategies.
Align eligibility, treatment initiation, time zero, and follow-up.
Avoid inappropriate exposure categories based on future information.
Define the outcome, follow-up period, and causal estimand.
Identify relevant confounders and assess their measurement quality.
Evaluate positivity, consistency, missing data, and selection concerns.
Choose analytical methods consistent with the specified strategies and estimand.
Report departures from the hypothetical trial and remaining assumptions.
08 · Frequently Asked Questions

Frequently Asked Questions About Hypothetical Target Trials

What is a hypothetical target trial?

It is the randomized experiment that would ideally answer a specified causal question, including its eligibility criteria, treatment strategies, follow-up, outcomes, and analysis.

Why use a target trial when randomization is impossible?

It clarifies the causal question and helps align observational data with a coherent intervention comparison while exposing assumptions and potential biases.

Is target trial emulation the same as a randomized controlled trial?

No. Emulation uses observational data and remains dependent on assumptions about treatment selection, confounding, measurement, and other biases.

What is time zero in target trial emulation?

It is the starting point at which eligibility, treatment assignment or initiation, and follow-up are aligned for the causal comparison.

What is immortal time bias?

It is a time-related bias that can arise when periods required to qualify for an exposure group are handled incorrectly, creating unequal opportunities for outcome occurrence.

Can target trials examine sustained treatment use?

Yes. They can define sustained treatment strategies, but observational estimation may require methods addressing time-varying confounding and adherence.

Does target trial emulation eliminate unmeasured confounding?

No. It improves design specification but cannot automatically eliminate confounding or recover missing information.

Should descriptive observational studies use target trials?

Not necessarily. A hypothetical target trial is particularly useful for causal intervention questions rather than studies whose purpose is simply to describe a population or phenomenon.

09 · The Bottom Line

Define the Ideal Causal Experiment Before Analyzing Observational Data

The Bottom Line

Observational studies investigating well-defined causal intervention effects can benefit substantially from specifying the hypothetical randomized trial they seek to emulate.

The framework clarifies eligibility, treatment strategies, time zero, follow-up, outcomes, and estimands while exposing avoidable biases. It does not eliminate confounding or turn observational data into randomized evidence. Its value lies in making the causal design and its assumptions explicit before estimation.

10 · Sources and Further Reading

Authoritative Sources on Target Trials and Observational Causal Research

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes