Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Should Differences in Resources Justify a New Study?

Resource differences can justify new research when they plausibly change whether an intervention can be delivered, accessed, sustained, or produce the expected outcome. Being “lower resource” is not enough by itself.

591
Do Resource Differences Justify a New Study? Guide 591 of 760
01 · The Question

If Resources Are Different, Do We Need Another Study?

An intervention has already worked elsewhere, but the studies were conducted under conditions unlike yours. Their schools had individual student devices. Their hospitals had more specialists. Their research sites had dedicated personnel. Their organizations had stronger technical infrastructure, more time, or greater funding.

Your setting has fewer of those resources. Does that difference justify collecting new evidence?

Sometimes it does. Resources can determine whether an intervention reaches people, whether its essential components are delivered, how consistently it is implemented, and whether it can be sustained. But describing a setting as “resource constrained” does not automatically establish a research gap. The scientific question is which resource differs, how that resource enters the mechanism or implementation process, and what uncertainty follows from its absence or scarcity.

02 · The Short Answer

Resource Differences Matter When They Could Change Delivery, Exposure, or Outcomes

In Brief

Differences in resources can justify a new study when staffing, funding, infrastructure, equipment, technology, expertise, time, transportation, or another form of capacity is sufficiently connected to the phenomenon or intervention that the difference could plausibly change feasibility, implementation, exposure, effectiveness, harms, costs, or sustainability.

The appropriate study is not necessarily another efficacy trial. If existing evidence already establishes that an intervention can work, the unresolved local question may instead concern whether it can be implemented effectively and sustainably with the resources actually available.

03 · What You Need to Know

Resources Matter When They Are Part of What Makes the Intervention Work

“Low resource” is a description, not yet an explanation

Resource availability is multidimensional. A setting can have adequate funding but insufficient specialist personnel. Another may have trained staff but unreliable infrastructure. A school can own enough devices but lack connectivity, technical support, or teacher preparation time. A hospital may have equipment but insufficient capacity to maintain or operate it consistently.

For research purposes, broad labels such as “resource-rich” and “resource-poor” can therefore hide the variable that actually matters.

Resource difference The target setting has more or less funding, staffing, infrastructure, technology, expertise, equipment, time, or another form of capacity than settings represented in previous research.
Scientifically meaningful resource difference The resource difference affects a condition necessary for exposure, implementation, mechanism, measurement, outcomes, or practical use of the intervention.

The second is the stronger justification for another study. This follows the broader principle that contextual differences matter scientifically when they can change the inference.

Ask what the resource actually enables

A useful way to evaluate a resource difference is to work backward from the intervention or phenomenon.

What must happen for the expected outcome to occur? Which personnel, infrastructure, equipment, time, skills, or financial inputs make those processes possible? What happens when those inputs are reduced?

Suppose an intervention depends on weekly individualized sessions delivered by trained specialists. A setting with substantially fewer specialists may be unable to reproduce the intervention dosage. Specialist availability is then connected directly to implementation.

By contrast, a difference in an organizational resource unrelated to intervention delivery may have little bearing on the effect. The fact that one institution has a smaller overall budget does not establish that every intervention will perform differently there.

Resource constraints can change the intervention people actually receive

An intervention can retain the same name while becoming materially different under constrained conditions.

Staff shortages may reduce session frequency. Limited equipment may require participants to share access. Insufficient time may shorten training. Connectivity problems may interrupt digital activities. Lack of technical support may increase downtime. Transportation constraints may reduce attendance.

These changes can affect intervention fidelity, dosage, reach, adoption, engagement, and continuity.

Implementation research frameworks such as the Consolidated Framework for Implementation Research explicitly include available resources within the implementation context because resource availability can influence implementation success. Empirical implementation research has likewise shown that settings with greater resource availability may reach implementation readiness more readily, while resource-limited settings may require greater adaptation.

Resource constraints may reduce effectiveness without challenging efficacy

This distinction is important.

An intervention may genuinely produce the intended effect when delivered as designed. If a resource-constrained setting cannot deliver the intervention with adequate intensity or fidelity, weaker outcomes do not necessarily show that its underlying mechanism is false.

Instead, they may show that the implementation model assumes resources that are unavailable in routine practice.

This changes the research question. Rather than asking only, “Does the intervention work here?” researchers may need to ask, “Can the intervention's essential functions be delivered with the resources available here, and what outcomes result under those conditions?”

Resource constraints can sometimes change the causal mechanism itself

Not every resource issue is merely an implementation inconvenience. Some resources are integral to the intervention's active ingredients.

Consider a digital formative-assessment system that depends on students completing frequent assessments and teachers receiving immediate diagnostic information. If students have only intermittent access to devices or connectivity, they receive less of the process believed to produce the learning benefit.

Similarly, a clinical intervention requiring rapid diagnostic testing may operate differently when laboratory turnaround times are substantially longer.

In such cases, the resource environment changes exposure to the mechanism itself.

Resource differences can affect access and who participates

Resources can also alter the composition of the population that actually receives an intervention.

A digital program may be theoretically available to everyone while reliable access is concentrated among participants with better devices or connectivity. A healthcare service may exist but remain inaccessible to people who cannot afford transportation or associated costs. A training program may disproportionately reach employees whose workloads permit participation.

This creates questions about reach and equity as well as average effectiveness.

A local study can therefore be justified not only because the mean effect might differ, but because resource constraints may change who receives the intervention and who benefits from it.

Resources can change feasibility even when effectiveness probably transfers

Existing evidence may provide little reason to doubt the intervention's effect among people who actually receive it. The unresolved issue may instead be whether the organization can deliver it at all.

Feasibility questions can concern staffing ratios, training requirements, equipment, workflow, infrastructure, time, maintenance, supply chains, or costs. These are legitimate research questions when they determine whether evidence can be translated into practice.

They should be described accurately. There is no need to manufacture uncertainty about the underlying effect when the real uncertainty concerns delivery.

Resource differences can change costs and opportunity costs

An intervention affordable in one system may impose substantially different costs elsewhere. Personnel costs, equipment prices, infrastructure requirements, transportation, maintenance, licensing, training, and competing demands on staff time can all vary.

More importantly, resources committed to one intervention cannot simultaneously be used elsewhere.

A program that produces worthwhile benefits under one budget constraint may be a poor local choice when it displaces services with greater expected benefit. Conversely, a relatively inexpensive intervention may become particularly attractive where alternatives require scarce specialist capacity.

Resource differences can therefore justify local economic or decision-oriented evidence even when clinical or educational effectiveness is already reasonably established.

Adaptation may be preferable to simply testing an infeasible model

If an intervention was designed around resources unavailable locally, reproducing the original model unchanged may answer a question nobody needs answered.

Researchers may instead need to adapt delivery. Specialists might train generalists. Face-to-face components might be reorganized. Technology requirements might be reduced. Frequency or workflow might change.

Adaptation introduces another question: which components can change without losing the intervention's essential functions?

A strong study documents these adaptations and evaluates their consequences. Otherwise, a negative result can be difficult to interpret because the supposedly replicated intervention may have been substantially altered without adequate measurement.

Do not assume that more resources always produce better outcomes

Resource availability often facilitates implementation, but the relationship is not mechanically linear. Additional equipment does not improve outcomes if it is unused. More personnel may not solve a poorly designed workflow. Greater funding can support implementation without addressing an institutional barrier that prevents adoption.

This is why resource analysis should be connected to mechanisms rather than relying on a simple rich-versus-poor comparison.

The neighboring question of whether institutional differences justify another study may sometimes provide a better explanation than resources alone.

Existing evidence may already include resource diversity

Before proposing a new study, examine the entire evidence base. AHRQ guidance on applicability emphasizes judging the body of evidence rather than one study in isolation and examining whether relevant populations, interventions, and settings are already represented.

If an intervention has been evaluated successfully across settings with different staffing levels, infrastructure, expertise, and delivery arrangements, existing evidence may already support reasonably broad applicability.

If almost all studies were conducted in unusually well-resourced research centers, uncertainty about routine or constrained settings may be substantially greater.

Resource differences can change absolute outcomes without changing relative effects

AHRQ's applicability framework also highlights baseline risk. Even when a relative effect remains similar across settings, different underlying risks can produce different absolute benefits and harms.

Resource environments can contribute to those baseline differences. For decision-makers, the resulting absolute outcomes may matter more than whether the relative effect itself varies.

Local data can therefore be useful for estimating expected impact without requiring researchers to repeat every element of the original effectiveness study.

The local study should measure the resource constraint it invokes

If limited resources provide the rationale for another study, resource availability should not disappear after the introduction.

Measure relevant staffing, access, infrastructure reliability, equipment availability, time, training, intervention dosage, costs, or other resource characteristics where feasible. Examine whether variation in these characteristics corresponds to implementation or outcomes.

Otherwise, a weaker result may simply be attributed to “resource limitations” after the fact without evidence that those limitations actually explain it.

Watch Out

Do not compare an intervention tested under intensive research support with routine local implementation and conclude that the intervention itself is less effective locally without examining what participants actually received. Differences in staffing, training, dosage, infrastructure, and implementation support may be central to the discrepancy.

Sometimes existing evidence plus local resource data is enough

A new effectiveness study is not the only way to resolve a resource question.

Suppose robust evidence establishes an intervention's effect, and the only important local uncertainty is whether enough trained personnel exist to deliver it. Workforce data, workflow analysis, costing, feasibility assessment, or implementation research may answer that question more efficiently.

This follows the broader principle that new local research should target what international evidence leaves unresolved.

04 · A Practical Example

When Limited Resources Change the Intervention Being Delivered

Hypothetical Example

Implementing a technology-supported tutoring program

Suppose multiple rigorous studies show that a technology-supported tutoring program improves mathematics achievement. Previous studies provide students with individual devices, stable internet connectivity, trained tutors, and scheduled tutoring sessions.

Local difference The target schools have shared devices, intermittent connectivity, fewer trained tutors, and limited time for additional sessions.
Mechanism The program depends on regular individualized practice, immediate feedback, and tutor intervention when students encounter persistent difficulties.
Uncertainty Resource constraints could reduce students' exposure to these active components. The unresolved question is therefore not simply whether tutoring can improve mathematics achievement.
Study design Researchers examine device access, connectivity, tutoring dosage, tutor workload, implementation fidelity, adaptations, costs, and student outcomes under realistic local conditions.
Interpretation If outcomes remain favorable despite lower resource intensity, the study provides evidence that the model is robust to those constraints. If outcomes weaken alongside reduced dosage or access, the study can identify which resource bottlenecks may need to be addressed or redesigned.

The contribution comes from understanding what happens when resources connected to the intervention's mechanism change, not merely from demonstrating that the schools have less money or equipment than those in earlier studies.

05 · What Researchers Often Get Wrong

Common Mistakes When Using Resource Differences to Justify Research

Misconception

“Our Setting Has Fewer Resources, So Previous Evidence Does Not Apply”

Resource scarcity does not make all external evidence inapplicable. Identify which resource differs, whether the intervention depends on it, and how the difference could alter implementation or outcomes.

Misconception

“Low Resource” Is a Sufficient Description of Context

It is too broad for many scientific purposes. Specify whether the relevant constraint concerns personnel, expertise, funding, infrastructure, equipment, time, transportation, technology, maintenance, or another form of capacity.

Misconception

A Smaller Effect Means the Intervention Does Not Work in Resource-Constrained Settings

Not necessarily. Participants may have received a lower dosage, different delivery model, or incomplete intervention. Examine implementation and exposure before attributing the discrepancy to a failure of the underlying mechanism.

Misconception

The Only Solution Is to Repeat the Original Trial Locally

The unresolved issue may concern feasibility, workforce, costs, adaptation, reach, fidelity, or sustainability. A focused implementation or decision-oriented study may answer the question more efficiently.

Misconception

More Resources Would Automatically Solve the Problem

Resources interact with institutional arrangements, implementation processes, skills, incentives, and behavior. Increasing inputs without understanding the mechanism may leave the actual implementation barrier unchanged.

06 · What This Means for You

Connect the Resource Constraint to the Part of the Intervention It Could Change

If resources are central to your rationale, avoid writing only that previous studies were conducted in “better-resourced settings.” Identify the resource, the function it supports, and the consequence you expect when it is constrained.

Then choose a design that addresses that uncertainty.

A simple decision framework

If the resource difference is unrelated to the mechanism or delivery of the intervention
Do not rely on it as the main justification for another study.
If a scarce resource is essential to delivering an active component
Study whether the intervention can maintain adequate exposure, fidelity, and outcomes under the local constraint.
If effectiveness is established but local feasibility is uncertain
Prioritize implementation, feasibility, adaptation, costing, or sustainability questions rather than automatically repeating efficacy research.
If resource constraints require adaptation
Document the adaptation, identify the functions that must be preserved, and evaluate what the adapted intervention actually delivers.
If existing studies already span resource conditions comparable to yours
Assess whether another local study would add enough new information to justify the required resources.
If local resource data can resolve the remaining decision uncertainty
Use the strongest existing effect evidence together with focused local data rather than recreating the entire evidence base.

A resource-constrained setting can provide scientifically valuable evidence precisely because it tests whether a finding depends on conditions often taken for granted elsewhere. The strongest studies make those conditions visible and measurable.

07 · A Quick Checklist

Before Using Resource Differences to Justify Another Study

Before collecting new data, check:
Can you identify the specific resource that differs rather than describing the setting only as resource constrained?
Can you explain what function that resource performs in the intervention or phenomenon?
Could the resource difference alter access, dosage, fidelity, reach, effectiveness, harms, costs, or sustainability?
Have you examined whether existing studies already include comparable resource conditions?
Is your unresolved question really about effectiveness, or is it primarily about feasibility or implementation?
Will you measure the relevant resource constraint and the implementation pathway through which it is expected to matter?
If adaptation is necessary, will you document what changes and which intervention functions remain intact?
Have you considered costs and opportunity costs rather than resource availability alone?
Could existing international evidence combined with focused local resource data answer the decision more efficiently?
08 · Frequently Asked Questions

Questions About Resource Differences and New Research

Does a lower-resource country automatically need its own study?

No. The relevant question is whether particular resource differences affect the population, intervention, mechanism, implementation, or decision. A broad economic classification alone does not establish that existing findings are inapplicable.

What kinds of resources can affect research applicability?

Depending on the question, relevant resources may include personnel, expertise, time, funding, infrastructure, equipment, technology, transportation, physical space, training, maintenance, supplies, and implementation support.

If an intervention requires resources we do not have, should we test it anyway?

Testing the original model unchanged may have limited practical value if it cannot realistically be delivered. It may be more useful to investigate an adapted delivery model while preserving the intervention functions believed to produce the benefit.

Can resource constraints change effectiveness?

Yes, particularly when they reduce access to or exposure to active intervention components. However, weaker observed outcomes can also reflect implementation failure rather than a change in the underlying efficacy of the intervention, so those possibilities should be distinguished.

Do I need another randomized trial to study resource differences?

Not necessarily. The appropriate design depends on the unresolved question. Feasibility studies, implementation research, economic evaluation, observational data, workflow analysis, or other designs may sometimes provide the needed evidence.

Can a resource-constrained setting contribute to generalizability?

Yes. When previous evidence comes mainly from highly resourced conditions, testing an intervention under meaningfully different resource constraints can reveal whether the finding is robust or dependent on particular implementation conditions.

09 · The Bottom Line

Resource Differences Matter When They Change What Can Actually Happen

The Bottom Line

Resource differences justify new research when they plausibly change access to an intervention, exposure to its active components, implementation, effectiveness, costs, harms, feasibility, or sustainability.

Specify the resource rather than relying on labels such as “low resource.” Explain what function it supports and collect evidence about the pathway through which it may affect outcomes. Often the most useful local study will not ask whether an established intervention can work in principle, but whether its essential functions can be delivered effectively with the resources actually available.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes