Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Do You Position a Trial on the Pragmatic-Explanatory Continuum?

Trials are rarely entirely explanatory or pragmatic. Learn how the PRECIS-2 framework evaluates nine design domains, how to interpret its five-point ratings, and how to position a trial according to the decisions its findings are intended to inform.

418
Positioning Trials on the Pragmatic-Explanatory Continuum Guide 418 of 1272
01 · The Question

How Can You Determine Whether Your Trial Is Explanatory, Pragmatic, or Somewhere Between?

You are designing a randomized trial of an AI-assisted research writing program across several universities. The study includes a broad range of postgraduate students, ordinary instructors, and existing academic support arrangements.

However, the intervention also requires a standardized set of core activities, trained outcome assessors, and carefully specified analytical procedures.

Some features resemble a pragmatic trial, while others appear more explanatory.

Should the study be labeled pragmatic because it takes place in ordinary universities? Does requiring a standardized intervention make it explanatory? Can the same trial legitimately have characteristics of both?

These questions cannot be answered reliably through a single label. They require examining how individual design choices align with the scientific or practical question the trial is intended to answer.

02 · The Short Answer

Evaluate the Trial Across Multiple Design Domains Rather Than Assigning a Binary Label

In Brief

A trial should be positioned on the pragmatic-explanatory continuum by examining how its design choices align with the purpose of the research. The PRECIS-2 framework provides a structured approach using nine domains, each rated from 1 (very explanatory) to 5 (very pragmatic).

These ratings describe the trial's design profile rather than its overall scientific quality. A trial may be pragmatic in eligibility and setting while more explanatory in intervention delivery or follow-up. Researchers should use the framework prospectively, justify each rating, and avoid treating a higher total score as evidence that the trial is necessarily better or more generalizable.

03 · What You Need to Know

Using the Pragmatic-Explanatory Continuum to Design and Describe Trials

What Is the Pragmatic-Explanatory Continuum?

The pragmatic-explanatory continuum describes how trial design choices may align with different research purposes.

An explanatory orientation emphasizes understanding intervention effects under selected conditions.

A pragmatic orientation emphasizes informing decisions about treatment strategies under conditions relevant to ordinary practice.

However, most trials do not fit neatly into one category.

They may combine broad eligibility with tightly specified intervention delivery, or use ordinary practitioners while collecting specialized outcome measures.

The continuum recognizes this multidimensional variation.

It is therefore more informative to examine specific design domains than to describe a trial as simply pragmatic or explanatory.

Why Is the Continuum More Useful Than a Binary Classification?

Binary labels can conceal important design differences.

For example, two trials may both describe themselves as pragmatic even though one uses broad eligibility and ordinary delivery while the other restricts participation and requires intensive specialist supervision.

Both may include features relevant to practical decisions, but their design profiles differ.

The continuum encourages researchers to specify which choices support their intended purpose and which may require reconsideration.

It also prevents the mistaken assumption that a trial must be entirely explanatory or entirely pragmatic.

What Is PRECIS-2?

PRECIS-2 stands for Pragmatic Explanatory Continuum Indicator Summary 2.

It was developed to help trial designers assess whether their planned methods are consistent with the trial's intended purpose.

The framework evaluates nine design domains using a five-point rating scale.

The ratings are commonly displayed on a wheel that makes the trial's design profile visible.

PRECIS-2 is intended primarily as a trial design aid, although it has also been used to characterize completed trials.

It is not a risk-of-bias instrument, a measure of methodological quality, or a direct test of generalizability.

What Are the Nine PRECIS-2 Domains?

Domain Central question More pragmatic orientation
1. Eligibility Who can participate? Participants resemble ordinary intervention recipients.
2. Recruitment How are participants recruited? Recruitment resembles routine pathways into treatment.
3. Setting Where is the trial conducted? Settings resemble intended usual practice environments.
4. Organization What resources and expertise are required? Delivery relies on resources and organization consistent with usual practice.
5. Flexibility of delivery How much discretion do providers have? Delivery flexibility resembles ordinary practice.
6. Flexibility of adherence How is participant adherence supported? Adherence support resembles usual care.
7. Follow-up How are participants followed? Follow-up resembles ordinary practice where appropriate.
8. Primary outcome What outcome is prioritized? The outcome directly matters to intended decision-makers or beneficiaries.
9. Primary analysis How is the primary effect estimated? Analysis aligns with the practical decision and intended treatment strategy.

The domains should be considered together, but each should receive its own justification.

How Does the PRECIS-2 Scoring Scale Work?

Each domain is rated on a scale from 1 to 5.

A score of 1 represents a very explanatory design choice, while a score of 5 represents a very pragmatic choice.

Intermediate scores indicate positions between these orientations.

Score Interpretation
1 Very explanatory
2 Rather explanatory
3 Equally explanatory and pragmatic
4 Rather pragmatic
5 Very pragmatic

Ratings require judgment based on the actual trial design and intended practice conditions.

Researchers should not assign scores merely according to whether a particular procedure sounds controlled or flexible.

For example, a standardized intervention may receive a pragmatic rating when identical delivery is how the intervention would ordinarily be implemented.

Should Researchers Calculate an Overall PRECIS-2 Score?

The PRECIS-2 wheel is intended to show the trial's profile across domains rather than reduce its design to one number.

Although researchers may calculate descriptive summaries, a total or average score can conceal important differences.

For example, a trial may have highly pragmatic eligibility but a very explanatory primary outcome.

An average could obscure the fact that the selected outcome does not directly inform the intended practical decision.

Researchers should prioritize domain-level interpretation and the coherence of the overall design.

There is no universal PRECIS-2 cutoff that establishes whether a trial qualifies as pragmatic.

How Should the Eligibility Domain Be Rated?

The eligibility domain concerns whether participants resemble those who would ordinarily receive the intervention.

For example, a university-wide learning program may be intended for students with different academic backgrounds and levels of digital literacy.

A trial excluding students with low prior achievement or limited technological experience may be more explanatory in eligibility.

However, restrictions justified by safety or the intervention's intended population are not automatically inappropriate.

Researchers should consider how broad eligibility criteria should be in pragmatic trials in relation to the target population.

How Is Recruitment Different From Eligibility?

Eligibility determines who may participate. Recruitment concerns how eligible individuals are identified, approached, and enrolled.

A trial may allow a broad population but recruit only highly motivated volunteers through specialized research advertisements.

Such recruitment may differ from the pathways through which individuals would ordinarily receive the intervention.

For example, a university-wide program might normally be offered through existing courses rather than through a voluntary research-interest mailing list.

Researchers should therefore rate eligibility and recruitment separately.

What Does the Setting Domain Assess?

The setting domain concerns how closely trial locations resemble those in which the intervention would ordinarily be used.

For example, an educational intervention evaluated in ordinary university classrooms may be more pragmatic in setting than one evaluated exclusively in a specialized research laboratory.

However, the label university does not automatically establish a pragmatic setting.

Participating institutions may have unusually advanced resources or specialized personnel.

Researchers should compare the actual study settings with the environments relevant to the intended decision.

What Does the Organization Domain Assess?

The organization domain considers the resources, expertise, infrastructure, and organizational arrangements required to deliver the intervention.

For example, a program requiring specialist facilitators and intensive research-team supervision may be more explanatory when ordinary institutions would not have those resources.

However, specialized delivery may be entirely consistent with usual practice for some interventions.

Researchers should determine whether the required organizational arrangements are part of the intended treatment strategy.

The domain should not be rated solely according to the absolute cost or complexity of the intervention.

What Does Flexibility of Delivery Assess?

This domain concerns the extent to which providers can deliver the intervention according to ordinary professional or institutional practice.

A trial may permit instructors to adapt examples, schedules, or delivery formats while preserving essential intervention functions.

Alternatively, it may require identical procedures beyond what ordinary implementation would demand.

The rating depends on the intended practice environment.

Researchers should consider how much intervention standardization is compatible with a pragmatic trial rather than assume that unrestricted flexibility is desirable.

What Does Flexibility of Adherence Assess?

The flexibility-of-adherence domain concerns the extent to which the trial uses procedures to encourage participant adherence beyond those expected in usual practice.

For example, frequent research-team reminders, additional coaching, or incentives designed specifically to increase treatment receipt may make the trial more explanatory in this domain.

However, adherence support may be part of the intended intervention package.

Researchers should distinguish ordinary treatment support from additional procedures introduced solely for research purposes.

The rating should reflect the intended treatment strategy and practice conditions.

What Does the Follow-Up Domain Assess?

The follow-up domain considers how closely outcome follow-up resembles the procedures that would occur in usual practice.

A trial requiring frequent specialized assessments may be more explanatory when such procedures are not ordinarily used.

However, the scientific need for valid outcome measurement remains important.

Researchers should not sacrifice essential follow-up or create excessive missing data merely to obtain a more pragmatic rating.

The relevant question is whether follow-up procedures impose additional demands beyond those appropriate for the trial's purpose.

What Does the Primary Outcome Domain Assess?

The primary outcome domain considers whether the selected outcome is relevant to the people and organizations making or experiencing the treatment decision.

For example, an educational intervention may be evaluated using a short knowledge quiz or an independently completed research proposal.

If universities are deciding whether to adopt the intervention to improve research writing competence, proposal quality may be more directly relevant.

However, outcome validity and feasibility also matter.

Researchers should consider the selection of meaningful outcomes in pragmatic trials rather than choose measures solely for convenience.

What Does the Primary Analysis Domain Assess?

The primary analysis domain concerns whether the analytical approach estimates an effect relevant to the intended practical decision.

Pragmatic trials often emphasize effects of assignment to treatment strategies under ordinary adherence and implementation conditions.

However, the appropriate analysis depends on the estimand and randomization design.

An intention-to-treat approach may support a pragmatic question, but it does not automatically make the entire trial pragmatic.

Likewise, a per-protocol analysis does not automatically establish an explanatory effect.

Researchers should define the target effect and choose methods appropriate to its causal assumptions.

Can a Trial Be Highly Pragmatic in Some Domains and Explanatory in Others?

Yes. This is one of the central reasons to use a multidimensional framework.

For example, a trial may recruit students through ordinary courses, use existing university facilities, and permit flexible instructional delivery.

At the same time, it may use specialist outcome assessments and intensive adherence monitoring.

These features produce a mixed profile.

Researchers should examine whether the differences are justified by the intended research question.

A mixed profile is not automatically a design weakness.

How Should Researchers Assign Ratings?

Ratings should be based on a clear description of each design domain and the intended usual practice comparator.

Researchers may conduct a structured discussion involving trial designers, implementation specialists, practitioners, and other relevant stakeholders.

Disagreements can reveal uncertainty about what ordinary practice actually involves.

For example, investigators may believe that weekly specialist supervision is routine, while participating institutions report that such support is unavailable.

Resolving the disagreement may require additional information about the target setting.

Ratings should be justified rather than treated as purely mechanical calculations.

Should PRECIS-2 Be Applied Before or After Trial Design?

Its principal value lies in prospective trial design.

Researchers can use the framework to identify choices that do not align with the intended explanatory or pragmatic objective.

For example, a trial intended to inform university-wide adoption may discover that its eligibility criteria exclude many ordinary recipients.

The design can then be reconsidered before recruitment begins.

PRECIS-2 can also be used descriptively after a trial has been conducted, but retrospective ratings do not correct design limitations.

Can PRECIS-2 Scores Be Compared Across Trials?

Comparisons may be informative when ratings are applied consistently and interpreted within the relevant research contexts.

However, the meaning of a score depends on the intervention and what constitutes usual practice.

For example, highly standardized delivery may be routine for one treatment but unusual for another.

Researchers should therefore avoid interpreting numerical differences as direct measures of scientific quality or generalizability.

Comparisons should consider domain-level justifications rather than rely exclusively on totals.

Does a More Pragmatic Profile Guarantee External Validity?

No. A trial may resemble usual practice in participating settings while remaining poorly representative of other target institutions.

For example, a pragmatic educational trial conducted exclusively in well-resourced universities may not provide sufficient evidence for institutions with limited connectivity.

PRECIS-2 helps assess alignment with pragmatic design intentions, but it does not directly establish transportability.

Researchers should separately evaluate whether participants, settings, and treatment strategies correspond to the population and decision of interest.

Does a More Explanatory Profile Mean Lower Scientific Quality?

No. Explanatory design choices may be appropriate when researchers seek to establish efficacy under specified conditions or investigate a narrowly defined treatment strategy.

For example, specialist delivery and carefully controlled procedures may be necessary to evaluate a complex intervention during early development.

The quality of the trial depends on whether its design and analysis support the intended inference.

PRECIS-2 should not be used as a ranking system in which the highest pragmatic score automatically wins.

How Does PRECIS-2 Relate to Risk-of-Bias Assessment?

PRECIS-2 and risk-of-bias tools address different questions.

PRECIS-2 evaluates how trial design choices align with explanatory or pragmatic purposes.

Risk-of-bias tools such as RoB 2 evaluate whether particular features of a randomized trial may bias its effect estimate.

A trial may be highly pragmatic but have important bias concerns.

Another may be highly explanatory and have strong internal validity.

Researchers should not substitute PRECIS-2 ratings for methodological quality assessment.

How Should Researchers Use the PRECIS-2 Wheel?

The PRECIS-2 wheel visually represents the nine domain ratings.

Ratings closer to the center indicate more explanatory choices, while ratings toward the outer edge indicate more pragmatic choices.

The shape helps reveal differences between domains.

For example, a trial may have high ratings for eligibility and setting but lower ratings for adherence flexibility and follow-up.

Rather than treating this pattern as a defect, researchers should examine whether those choices correspond to the intended question.

The wheel is most useful as a structured discussion tool rather than a decorative label of trial quality.

How Should the Trial's Position Be Reported?

Researchers should describe the intended explanatory or pragmatic objective and the design choices supporting it.

When PRECIS-2 is used, domain ratings and their justifications should be reported sufficiently for readers to understand the assessment.

A wheel may provide a useful summary, but it should not replace detailed descriptions of eligibility, recruitment, intervention delivery, outcomes, and analysis.

Researchers should avoid claiming that a trial is fully pragmatic based on one or two design features.

The most informative reporting explains how the overall design corresponds to the decision the trial is intended to support.

04 · A Practical Example

Applying PRECIS-2 to an AI-Assisted Research Writing Trial

Hypothetical Example

A Multi-University Pragmatic Randomized Trial

Researchers design a randomized trial of an AI-assisted research writing program across six universities.

The primary question concerns whether introducing the program into ordinary postgraduate courses improves independently completed research proposals.

The team uses PRECIS-2 to examine whether the planned design is consistent with that adoption question.

PRECIS-2 domain Illustrative rating Design justification
Eligibility 5 Students ordinarily enrolled in participating courses are eligible.
Recruitment 4 Recruitment occurs through existing courses, with additional research consent procedures.
Setting 5 Intervention delivery occurs in ordinary university learning environments.
Organization 3 Ordinary instructors deliver the program but receive additional training.
Flexibility of delivery 4 Core functions are standardized while examples and scheduling may vary.
Flexibility of adherence 3 Participants receive reminders beyond some institutions' ordinary practice.
Follow-up 3 Research-specific proposal assessment supplements routine course evaluation.
Primary outcome 5 Independent proposal quality directly informs the adoption decision.
Primary analysis 5 The analysis targets the effect of offering the program under intended participation conditions.

These ratings are illustrative judgments rather than empirically validated scores for an actual trial. Formal PRECIS-2 assessment would require consideration of the full domain guidance and agreement about the intended usual practice conditions.

Define the trial purpose. The research team identifies the university adoption decision as the primary objective.
Describe each design domain. Eligibility, recruitment, setting, organization, delivery, adherence, follow-up, outcomes, and analysis are specified separately.
Assign provisional ratings. The team evaluates each domain using the PRECIS-2 five-point scale and documents its reasoning.
Examine the profile. The researchers identify relatively explanatory features in organization, adherence support, and follow-up.
Review alignment. The team determines whether additional training and reminders are part of the intended adoption package or primarily research-specific supports.
Revise where appropriate. Design choices are adjusted only when doing so improves alignment with the intended question without compromising essential intervention requirements or credible inference.
Report the final design. The trial protocol describes the domain ratings and explains why its mixed explanatory-pragmatic profile is appropriate.

The study is relatively pragmatic in eligibility, setting, primary outcome, and analysis, while retaining more explanatory features in other domains.

This mixed profile does not make the trial inconsistent or invalid.

Instead, it identifies specific design decisions that require justification and provides a structured basis for refining the trial before implementation.

05 · What Researchers Often Get Wrong

Common Misconceptions About the Pragmatic-Explanatory Continuum

Misconception

Trials Must Be Either Fully Pragmatic or Fully Explanatory

Most trials combine characteristics across domains. The continuum is multidimensional rather than a strict binary classification.

Misconception

A Higher PRECIS-2 Score Means a Better Trial

PRECIS-2 assesses design orientation, not universal methodological quality. The appropriate profile depends on the intended research question.

Misconception

A Trial Conducted in Ordinary Settings Is Automatically Pragmatic

Setting is only one domain. Eligibility, recruitment, delivery, adherence, follow-up, outcomes, and analysis also matter.

Misconception

PRECIS-2 Directly Measures External Validity

PRECIS-2 evaluates alignment with pragmatic or explanatory objectives. Generalizability requires additional consideration of target populations and contexts.

Misconception

PRECIS-2 Can Replace Risk-of-Bias Assessment

Pragmatic orientation and risk of bias are distinct methodological dimensions requiring different assessments.

Misconception

An Average PRECIS-2 Score Fully Describes the Trial

Average scores can conceal consequential differences between domains. Domain-level ratings and justifications are more informative.

06 · What This Means for You

Use the Continuum to Improve Trial Design, Not Merely to Label It

Begin with the research question and the decision the trial is intended to inform.

Then examine each PRECIS-2 domain and determine whether its design choices align with that purpose.

A simple decision framework

If the trial is intended to establish efficacy under selected conditions
Use explanatory design choices where they support the intended causal question.
If the trial is intended to inform routine adoption
Consider pragmatic choices reflecting the relevant population, providers, settings, and outcomes.
If PRECIS-2 ratings differ across domains
Examine whether the mixed profile is justified rather than forcing all ratings toward one end.
If a domain appears inconsistent with the intended question
Review the design choice and consider whether revision would improve alignment.
If the trial receives highly pragmatic ratings
Still assess internal validity, outcome measurement, and applicability to the target population separately.

Researchers should also consider whether the study primarily addresses efficacy or effectiveness and how that objective should shape the treatment strategy and estimand.

The purpose of positioning a trial on the continuum is to make its design choices more coherent and transparent, not to achieve a predetermined pragmatic score.

07 · A Quick Checklist

Before Positioning a Trial on the Pragmatic-Explanatory Continuum

Before finalizing the PRECIS-2 assessment, check:
Define the scientific or practical decision the trial is intended to inform.
Identify the relevant usual practice conditions and target population.
Describe all nine PRECIS-2 domains using the planned trial procedures.
Assign domain ratings using the five-point scale and appropriate guidance.
Document the rationale for each rating rather than relying on labels alone.
Examine disagreements about ordinary practice and resolve them using relevant evidence.
Review whether the resulting profile aligns with the intended research question.
Avoid treating average ratings or high scores as indicators of methodological quality.
Assess risk of bias and generalizability separately from PRECIS-2 orientation.
08 · Frequently Asked Questions

Frequently Asked Questions About the Pragmatic-Explanatory Continuum

What is the pragmatic-explanatory continuum?

It describes how trial design choices align with explanatory objectives focused on efficacy under selected conditions or pragmatic objectives focused on decisions in usual practice.

What is PRECIS-2?

PRECIS-2 is a structured trial design tool that assesses nine domains on a five-point explanatory-to-pragmatic scale.

How many domains does PRECIS-2 have?

Nine: eligibility, recruitment, setting, organization, flexibility of delivery, flexibility of adherence, follow-up, primary outcome, and primary analysis.

What does a PRECIS-2 score of 5 mean?

It indicates a very pragmatic design choice within the rated domain. It does not mean that the trial is necessarily superior.

Can a trial have both explanatory and pragmatic characteristics?

Yes. Different design domains may occupy different positions along the continuum.

Should researchers calculate an average PRECIS-2 score?

Domain-level interpretation is generally more informative. Averages may conceal important differences and should not be treated as universal classifications.

Does PRECIS-2 measure risk of bias?

No. It assesses explanatory-pragmatic design orientation, while risk-of-bias tools evaluate threats to the credibility of effect estimates.

When should PRECIS-2 be used?

It is particularly useful during prospective trial design, when researchers can revise choices that do not align with the intended purpose.

09 · The Bottom Line

A Trial's Position on the Continuum Is a Design Profile, Not a Quality Ranking

The Bottom Line

Trials should be positioned on the pragmatic-explanatory continuum by examining how individual design choices align with the research question. PRECIS-2 provides a structured nine-domain framework for doing so, with ratings from very explanatory to very pragmatic.

The purpose is not to maximize pragmatic scores or force trials into binary categories. Researchers should use the framework to identify inconsistencies, justify design choices, and communicate what their trial is intended to establish. Scientific quality and generalizability must still be assessed separately.

10 · Sources and Further Reading

Authoritative Sources on PRECIS-2 and the Pragmatic-Explanatory Continuum

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes