03 · What You Need to Know
Understanding the Structure, Types, and Methodological Requirements of Hybrid Studies
Where Did Hybrid Effectiveness-Implementation Designs Originate?
Curran and colleagues formally articulated the effectiveness-implementation hybrid design framework in a 2012 article published in Medical Care. Their framework proposed three types of studies that combine clinical effectiveness and implementation research with different emphases.
The approach emerged from recognition that evidence about an intervention's effectiveness and evidence about its implementation need not always be generated through completely separate research stages.
For example, researchers evaluating a promising intervention may simultaneously investigate organizational barriers that could influence future adoption.
The framework originated in health research, but its conceptual distinctions can inform intervention studies in education and other fields when the relevant constructs and methods are appropriately defined.
What Is the Difference Between Effectiveness and Implementation?
Intervention effectiveness
Whether an intervention produces the intended changes in outcomes among recipients under the conditions being evaluated.
Implementation
The processes involved in introducing, delivering, integrating, and maintaining an intervention in a particular setting.
Implementation strategy
A deliberate method used to improve implementation, such as provider training, facilitation, audit and feedback, or workflow redesign.
Implementation outcome
A measurable result of implementation efforts, such as adoption, fidelity, acceptability, feasibility, or sustainability.
These distinctions are essential because hybrid studies may evaluate both an intervention and a strategy intended to improve its implementation.
For example, a digital formative feedback program may be the educational intervention, while instructor training may be an implementation strategy. Student learning and instructor adoption would represent different outcomes.
What Are the Three Types of Hybrid Effectiveness-Implementation Designs?
The framework identifies Type 1, Type 2, and Type 3 designs according to their principal scientific emphasis.
| Hybrid type |
Primary emphasis |
Implementation component |
Illustrative educational application |
| Type 1 |
Test intervention effectiveness |
Explore implementation conditions, barriers, or facilitators |
Test a learning intervention while studying instructor experiences and delivery challenges |
| Type 2 |
Test intervention effectiveness and an implementation strategy |
Substantial evaluation of both domains |
Test learning outcomes while evaluating a strategy intended to improve instructor adoption |
| Type 3 |
Test an implementation strategy |
Observe intervention effectiveness or recipient outcomes |
Test a faculty facilitation strategy while monitoring student learning outcomes |
The numbers do not represent levels of methodological sophistication or a mandatory sequence of research stages.
Each type is appropriate for different scientific uncertainties. A Type 3 study is not inherently more rigorous than a Type 1 study.
What Is a Type 1 Hybrid Effectiveness-Implementation Design?
A Type 1 hybrid primarily evaluates intervention effectiveness while gathering information about implementation.
Its central question concerns whether the intervention produces the intended outcomes. The implementation component may examine delivery barriers, stakeholder experiences, fidelity, or contextual factors relevant to future adoption.
For example, researchers might evaluate whether a digital learning intervention improves problem-solving performance while interviewing instructors about workload and technical difficulties.
The effectiveness component requires an appropriate design for the intended inference. The implementation component should also have explicit objectives and suitable methods.
Exploratory implementation observations should not be presented as definitive evidence that a particular implementation strategy caused improved adoption.
What Is a Type 2 Hybrid Effectiveness-Implementation Design?
A Type 2 hybrid gives substantial emphasis to both intervention effectiveness and implementation research, commonly involving tests of an intervention and a strategy intended to improve its implementation.
For example, researchers may investigate whether a formative feedback intervention improves learning while also evaluating whether structured faculty facilitation increases adoption and fidelity.
The two objectives may require different comparisons, outcomes, and units of analysis.
Student learning may be measured at the individual level, whereas adoption may be measured at the department or institutional level.
A Type 2 label does not automatically establish adequate statistical power for both objectives. Researchers must plan the design around the actual effects they intend to estimate.
What Is a Type 3 Hybrid Effectiveness-Implementation Design?
A Type 3 hybrid primarily tests an implementation strategy while observing intervention effectiveness or relevant recipient outcomes.
It is particularly relevant when the intervention already has sufficient evidence of benefit for the intended research context, but uncertainty remains about how to introduce or sustain it.
For example, an evidence-supported instructional intervention may be available but poorly adopted across university departments. Researchers could test whether implementation facilitation improves adoption while monitoring student outcomes.
The primary causal question would concern the implementation strategy rather than establishing the intervention's effectiveness anew.
Monitoring student outcomes does not automatically establish equivalence, noninferiority, or adequate power to detect changes in effectiveness.
How Does a Hybrid Design Differ From a Conventional Effectiveness Trial?
A conventional effectiveness trial primarily investigates whether an intervention produces intended outcomes under specified conditions.
It may collect process or fidelity information without formally incorporating implementation research as a substantial objective.
A hybrid study explicitly includes implementation questions within its scientific design.
The distinction concerns the purpose and methodological treatment of implementation, not merely whether a study contains a few additional questionnaires.
Researchers should consider which implementation outcomes need to accompany effectiveness measurement before deciding how extensively implementation should be studied.
Is a Hybrid Design the Same as a Pragmatic Trial?
No. Pragmatic trials emphasize the relevance of intervention evaluation to routine practice. Hybrid designs concern the coordinated investigation of effectiveness and implementation.
A pragmatic trial may focus exclusively on effectiveness under routine conditions, while a hybrid study may include implementation research without making every design feature highly pragmatic.
A study can be both pragmatic and hybrid.
The question of whether an intervention study should reflect real-world practice should therefore be considered separately from its hybrid classification.
Is a Hybrid Design the Same as Mixed-Methods Research?
No. Mixed-methods research integrates qualitative and quantitative approaches to address a research problem.
Hybrid effectiveness-implementation research is defined by its coordinated scientific objectives concerning intervention effects and implementation.
A hybrid study may use mixed methods, but it may also rely primarily on quantitative or other suitable approaches.
Similarly, a mixed-methods intervention study is not automatically hybrid merely because it includes interviews alongside outcome measurements.
Researchers should specify both the hybrid design orientation and the methodological approaches used to address its questions.
Does a Hybrid Design Require Randomization?
No. Hybrid studies may use randomized, quasi-experimental, observational, qualitative, or mixed-methods approaches, depending on their objectives.
However, causal claims about an intervention or implementation strategy require an appropriate identification strategy.
Randomization may occur at the individual, provider, team, or organizational level.
For example, an implementation strategy delivered to entire departments may require cluster-level assignment to avoid contamination.
The choice should reflect how the intervention and implementation strategy operate, rather than assume that individual randomization is always suitable.
What Are the Units of Analysis in a Hybrid Study?
Hybrid studies frequently involve outcomes measured at different levels.
Intervention effectiveness may concern individual recipients, while implementation outcomes may concern providers, teams, departments, or organizations.
For example, student learning outcomes may be nested within courses, and courses may be nested within universities.
Implementation adoption may be measured as a department-level decision, while fidelity may be assessed at the instructor or session level.
Researchers should specify the unit of assignment, measurement, and analysis for each objective.
Ignoring clustering or treating organizational outcomes as independent individual observations can produce misleading precision estimates.
How Should Primary and Secondary Outcomes Be Selected?
Outcome selection should reflect the study's hybrid type and intended conclusions.
Type 1 studies usually prioritize an effectiveness outcome. Type 3 studies generally prioritize an implementation outcome associated with the strategy being evaluated.
Type 2 studies require substantial attention to both domains, although the precise structure of primary and secondary outcomes depends on the protocol.
Researchers should define estimands, measurement timing, comparison conditions, and analytical priorities prospectively.
Proctor and colleagues' implementation outcome framework provides a useful taxonomy, including acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability.
Not every hybrid study requires measurement of all eight constructs.
How Should Sample Size Be Calculated?
Sample size should be planned according to the primary objectives and relevant units of assignment and analysis.
A Type 1 study may be powered primarily for an intervention effectiveness comparison while collecting exploratory implementation information.
A Type 2 study may require adequate precision or power for both effectiveness and implementation strategy effects.
A Type 3 study may be powered for an implementation outcome measured at the organizational level.
For example, a large number of students cannot compensate automatically for having too few departments to estimate a department-level implementation strategy effect.
Researchers should account for clustering, unequal group sizes, expected effects, and other design-specific considerations.
What Role Does Implementation Context Play?
Implementation context can influence adoption, fidelity, intervention exposure, and the effectiveness of implementation strategies.
Relevant factors may include staffing, leadership, infrastructure, organizational policies, and participant characteristics.
For example, a faculty training strategy may produce different adoption patterns across institutions with different workloads or technical support arrangements.
Researchers should examine how implementation context can help explain intervention outcomes when contextual variation is relevant to the study.
However, identifying an association between context and outcomes does not automatically establish a causal explanation.
Can Hybrid Studies Evaluate Intervention Adaptation?
Yes. Hybrid studies may investigate how interventions are adapted during implementation and whether essential functions are preserved.
Adaptation may be necessary when interventions are delivered across settings with different resources or participant needs.
Researchers should distinguish planned adaptations from unapproved deviations and document consequential modifications.
The distinction between core and adaptable intervention components helps define what constitutes acceptable delivery variation.
Where adaptation changes the intervention itself, findings from the original version should not automatically be generalized to the modified version.
What Implementation Strategies Can Be Evaluated?
Implementation strategies are deliberate approaches intended to improve the introduction or delivery of an intervention.
Examples include educational meetings, provider training, implementation facilitation, audit and feedback, and organizational workflow changes.
The Expert Recommendations for Implementing Change project, known as ERIC, developed a compilation of implementation strategies that can support systematic identification and reporting.
However, naming a strategy is not enough. Researchers should specify who delivers it, to whom, with what intensity, at what time, and toward which implementation outcome.
Strategies may operate at different organizational levels and require distinct evaluation methods.
How Can Hybrid Studies Address Intervention Fidelity?
Fidelity measurement can help establish whether essential intervention functions were delivered and whether implementation strategies were performed as intended.
For example, researchers may need to distinguish fidelity to a student feedback intervention from fidelity to the instructor training strategy intended to support its delivery.
These are different constructs and may require separate measurement procedures.
Researchers should also consider whether permitted adaptations preserve essential intervention functions.
Fidelity data can support interpretation, but associations between fidelity and effectiveness do not independently establish causal mechanisms.
How Should Implementation and Effectiveness Data Be Integrated?
Integration should follow the study's objectives and analytical framework.
Quantitative analyses may estimate intervention effects and implementation strategy effects separately. Qualitative findings may help explain observed barriers or differences in delivery.
Researchers may also examine associations between implementation measures and recipient outcomes, subject to appropriate causal assumptions.
However, an association between high fidelity and favorable outcomes does not prove that fidelity caused those outcomes.
The study should distinguish confirmatory comparisons from descriptive or exploratory analyses.
What Is the Relationship Between Hybrid Designs and Implementation Frameworks?
Hybrid designs describe how effectiveness and implementation research objectives are combined. Implementation frameworks help specify constructs, determinants, processes, or outcomes relevant to those objectives.
For example, CFIR may support investigation of implementation determinants, while Proctor and colleagues' taxonomy can guide implementation outcome selection.
RE-AIM may help organize questions about reach, effectiveness, adoption, implementation, and maintenance.
These frameworks are not interchangeable with the hybrid design classification itself.
Researchers should select frameworks according to their intended analytical purpose rather than include multiple frameworks merely to make the study appear comprehensive.
What Are the Main Advantages of Hybrid Designs?
Hybrid designs may permit researchers to investigate implementation barriers while generating effectiveness evidence, potentially informing future adoption more efficiently than strictly separated research stages.
They can also encourage early consideration of provider experiences, organizational resources, and delivery requirements.
However, these advantages depend on the study being appropriately designed and resourced.
Adding implementation research may increase the number of outcomes, assessment procedures, organizational participants, and analytical decisions.
Hybrid designs should therefore be justified by the value of the additional information rather than an assumption that combining objectives is inherently more rigorous.
What Are the Main Limitations of Hybrid Designs?
Hybrid studies can become difficult to implement when effectiveness and implementation objectives require different comparison structures, sample sizes, or data collection schedules.
For example, a study may have sufficient student participants to estimate learning effects but too few institutions to test an organizational implementation strategy reliably.
Additional measures may also increase participant and provider burden.
Researchers should consider when adding implementation questions makes an effectiveness study too ambitious.
A hybrid design does not compensate for inadequate causal identification, poor measurement, or insufficient information at the relevant organizational level.
How Should Hybrid Studies Be Reported?
Reports should identify the hybrid type and explain why it was selected.
Researchers should describe the intervention, implementation strategies, objectives, outcomes, comparison conditions, assignment units, analytical methods, and relevant contextual characteristics.
They should also report intervention delivery, fidelity, adaptations, and missing data where relevant.
Reporting guidance such as CONSORT for randomized trials and TIDieR for intervention descriptions may apply alongside implementation-specific reporting resources.
Transparent reporting helps readers determine what the study evaluated and which conclusions are supported by the evidence.
Watch Out
A hybrid effectiveness-implementation design is not simply an effectiveness study with an added satisfaction survey. The implementation component must address a defined scientific objective, and the selected methods must support the conclusions researchers intend to draw.
