Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Can Strong International Evidence Compensate for Very Little Local Evidence?

Strong international evidence can tell you a great deal when local research is scarce, but it cannot answer every question about your setting. The key is to identify what can reasonably transfer and what still requires local information.

810
International Evidence When Local Evidence Is Limited Guide 810 of 899
01 · The Question

What if the international evidence is strong but the local literature is almost empty?

Suppose dozens of studies from several countries point in the same direction. Perhaps there is even a rigorous systematic review. You then search your own country, province, city, or institution and find one small study, an old report, or nothing directly comparable.

Does the lack of local research prevent you from using the international evidence? Usually not. But it creates a different question: how much of what has been learned elsewhere can reasonably be expected to apply under your local conditions?

Strong international evidence can reduce uncertainty about some parts of that question. It cannot manufacture local information that has never been collected.

02 · The Short Answer

International evidence can compensate for some missing local research, but not for every missing local fact

In Brief

Strong international evidence can provide a defensible basis for understanding effects, relationships, mechanisms, and possible approaches even when local studies are scarce, provided there is no compelling reason to expect the finding to differ materially in your setting.

It cannot substitute for local information needed to establish the magnitude of a local problem, available resources, costs, implementation constraints, population characteristics, values, institutional arrangements, or other contextual factors that could change how the evidence should be interpreted or applied.

03 · What You Need to Know

The real question is not how much local evidence exists, but what information is missing

Start with what the international evidence actually establishes

“Strong international evidence” should mean more than a large number of papers from other countries. The relevant considerations include the methodological credibility of the studies, consistency and precision of findings, directness to the question, and, where available, the quality of an appropriate evidence synthesis.

A large literature can still provide uncertain evidence if the studies share serious limitations. Conversely, a well-conducted body of research across several settings may provide considerable information even when none of the studies comes from your locality.

Evidence-informed policymaking guidance has long treated the best available evidence from around the world as an appropriate starting point for judgments about the effects of policies and programmes. Restricting attention to a geographically local subset can itself be misleading when the broader evidence is relevant.

Do not ask whether international evidence “replaces” local evidence

Global and local evidence frequently answer different questions.

International studies may tell you whether an intervention has produced an effect across several settings, whether a relationship appears repeatedly, which mechanisms have been proposed, or which implementation approaches have been tried. Local evidence may tell you how common the problem is in your setting, what resources are available, how institutions operate, what an intervention would cost, whether the target population differs meaningfully, or what stakeholders consider acceptable.

Evidence that may transfer Evidence about effects, mechanisms, relationships, or approaches may sometimes remain informative across settings, especially when findings are consistent under varied conditions.
Evidence about the local setting Information about local prevalence, baseline conditions, resources, costs, institutional capacity, implementation barriers, values, and other contextual conditions generally cannot be supplied simply by accumulating more studies from elsewhere.

Consistency across different settings can strengthen the case for applicability

If similar findings have been observed across countries, populations, institutions, and time periods that differ in meaningful ways, there may be less reason to expect the result to disappear solely because it is applied in another setting.

Guidance on assessing the applicability of systematic-review findings specifically asks whether studies were conducted in the same or similar settings and whether findings were consistent across settings and periods. Consistency under varied conditions can support a judgment that findings are broadly applicable.

That judgment still requires care. The absence of observed variation does not prove that no important contextual modifier exists, particularly when the available studies represent only a narrow range of settings.

Look for effect modifiers rather than demanding a local replication automatically

The most useful question is often: What could plausibly make the finding different here?

Potential effect modifiers depend on the topic. They might include age or population composition, baseline risk, socioeconomic conditions, culture, institutional arrangements, infrastructure, implementation fidelity, professional expertise, technology access, regulatory environments, environmental exposure, or the precise form of an intervention.

If the international evidence already includes substantial variation across the factors most likely to matter and the findings remain reasonably consistent, the case for transferability becomes stronger. If your local setting differs on a factor known or plausibly expected to modify the result, local evidence becomes more important.

Absolute effects may change even when relative effects transfer

This distinction is particularly important for interventions and risk-related questions.

An intervention can have a similar relative effect across settings while producing different absolute benefits because the baseline level of risk or need differs. Guidance on applicability explicitly identifies baseline conditions as a factor that can change expected absolute effects even when relative effectiveness is similar.

This means that international evidence about effectiveness may remain informative while local baseline data are still needed to estimate what that effectiveness could mean in practice.

Implementation can be more context-sensitive than efficacy

An intervention that has worked elsewhere may depend on staffing, infrastructure, supply chains, institutional authority, training, financing, or user acceptance that cannot be assumed locally.

The underlying intervention may be effective, yet the local system may be unable to deliver it in the same way. Conversely, adaptations needed for local implementation may change the intervention enough that the original evidence becomes less directly applicable.

World Health Organization guidance on contextualizing evidence-based recommendations similarly emphasizes fitting evidence to available resources and organizational contexts rather than simply transferring recommendations unchanged.

Some local questions cannot be answered by international research at all

Suppose your question is, “What proportion of teachers in this province currently use generative AI?” A hundred international studies cannot provide that prevalence estimate.

They can help you choose definitions, instruments, predictors, or analytic approaches. They may show how AI use has been measured elsewhere. But the value of the local parameter remains unknown until appropriate local data exist.

The same applies to many questions about local costs, service availability, institutional capacity, stakeholder preferences, environmental conditions, and current implementation.

Watch Out

More international evidence does not gradually turn into local data. If the information you need is inherently specific to the setting, the limitation is not solved by finding another study from somewhere else.

Little local research does not mean no local evidence

Local evidence is broader than locally published journal studies. Depending on the question, useful local information may come from routine administrative data, surveys, government reports, institutional records, programme monitoring, qualitative research, stakeholder consultation, costs, implementation data, or other sources.

This distinction matters when a conventional literature search finds few local papers. Before concluding that local evidence is absent, consider whether the information needed for an applicability judgment exists in other forms.

A careful search designed around the local evidence environment may uncover material that a journal database does not.

Weak local studies should not automatically override stronger international evidence

A small local study may appear more directly relevant because it was conducted nearby. That does not make it methodologically stronger.

Guidance on using local conditions cautions against relying on local evaluations alone to estimate impacts when they are small or methodologically limited. Judgments are better informed in the context of all relevant evidence.

If a weak local study conflicts with a strong international evidence base, investigate the discrepancy. The local result might reveal a genuine contextual modifier, but it might also reflect bias, imprecision, measurement differences, or chance.

Where the local evidence is incompletely reported, preserve that uncertainty rather than giving it extra evidential weight simply because it is local.

04 · A Practical Example

When international evidence can answer one part of a local question but not another

Hypothetical Example

Introducing a digital formative-assessment system in a local school division

A school division is considering a digital formative-assessment approach. Several systematic reviews and numerous studies from other education systems suggest that well-designed formative assessment can improve learning under particular implementation conditions. No rigorous evaluation has been conducted in the local division.

1. Use the broader evidence for what it can establish The international literature helps identify expected mechanisms, implementation features, possible effects, and conditions associated with successful use.
2. Identify what remains locally unknown The division does not yet know whether schools have sufficient devices, connectivity, teacher preparation, technical support, or time to implement the approach as studied elsewhere.
3. Gather targeted local evidence Rather than commissioning a complete local replication of the international literature, the division assesses infrastructure, teacher readiness, implementation capacity, student access, and relevant costs.
4. Combine the evidence International research informs expectations about the approach, while local evidence determines whether the conditions required for implementation are present and what adaptations may be necessary.

The absence of a local effectiveness trial did not make the international evidence unusable. Nor did the strength of the international evidence answer questions about local infrastructure that had never been studied.

05 · What Researchers Often Get Wrong

Common mistakes when local evidence is scarce

Misconception

“Without a local study, we cannot say anything.”

That is usually too restrictive. Strong evidence from other settings can inform many questions. The task is to identify which conclusions are reasonably transferable and which still depend on local information.

Misconception

“If the international evidence is strong enough, local evidence is unnecessary.”

International evidence cannot establish inherently local facts such as current prevalence, resources, costs, implementation capacity, or stakeholder preferences. Some questions remain local regardless of how mature the international literature becomes.

Misconception

“A local study should outweigh international evidence because it matches the setting.”

Direct relevance is important, but it does not erase risk of bias or imprecision. A small, weak local study should be interpreted alongside the broader evidence rather than automatically replacing it.

Misconception

“Different country means different result.”

National boundaries do not themselves identify the mechanism that would change a finding. Look for substantive differences in populations, institutions, baseline conditions, implementation, culture, resources, or other plausible modifiers.

Misconception

“No local journal articles means no local evidence.”

Locally relevant information may exist in administrative systems, surveys, repositories, government reports, programme data, theses, and other sources. Publication scarcity and evidence scarcity are not identical.

06 · What This Means for You

Identify the local uncertainty that international evidence cannot resolve

A simple decision framework

If strong evidence shows similar findings across diverse settings and no important local modifier is apparent
The international evidence may provide a reasonable basis for the relevant conclusion while you acknowledge the absence of direct local evidence.
If your setting differs on a factor likely to affect the finding
Seek local evidence about that factor before assuming the international result will apply in the same way.
If the question asks for a local prevalence, cost, preference, capacity, or other setting-specific quantity
International evidence cannot supply the missing local value. Obtain appropriate local data or state that the quantity remains unknown.
If the local evidence conflicts with a stronger international evidence base
Investigate differences in methods, populations, baseline conditions, implementation, and other plausible modifiers rather than choosing one evidence source solely because of geography.

This turns a vague concern about “not enough local studies” into a more useful diagnostic question: Which local uncertainty could change the conclusion?

Sometimes the answer is “none that appears consequential,” and the broader evidence may be reasonably applicable. In other situations, the missing local information is central. Determining when local evidence becomes necessary before applying an international finding requires making that distinction explicitly.

07 · A Quick Checklist

Before relying heavily on international evidence in a local setting

Before applying the broader evidence, check:
Assess the strength of the international evidence rather than equating a large publication count with strong evidence.
Examine the populations, settings, interventions, exposures, and time periods represented in the broader evidence.
Check whether findings are reasonably consistent across meaningfully different settings.
Identify local factors that could plausibly modify the finding or alter its implementation.
Determine whether local baseline conditions could change the absolute magnitude of the expected outcome.
Identify which unanswered questions require genuinely local data rather than another international study.
Search beyond journal articles for local administrative, implementation, cost, resource, or stakeholder evidence where relevant.
State clearly when the application of international evidence remains uncertain because direct local evidence is unavailable.
08 · Frequently Asked Questions

Questions about using international evidence when local research is scarce

Do I need a local study before citing an international finding?

No. You can cite relevant international evidence for what it actually establishes. The separate question is whether you are justified in claiming that the same finding applies to your local population or setting.

Does evidence from many countries automatically generalize to mine?

No. Evidence across diverse settings can strengthen an applicability judgment, particularly when findings remain consistent, but you should still examine whether your setting differs on factors capable of changing the result.

What if there are no local effectiveness studies?

A local effectiveness study is not automatically required. Strong broader evidence may remain informative. Focus on whether local population characteristics, baseline conditions, implementation arrangements, or other contextual factors create reasonable doubt about applicability.

Can local administrative data help even if there are no local research studies?

Yes. Administrative data may provide information about local prevalence, service use, resources, implementation, or other contextual conditions needed to interpret international evidence. Its quality and suitability still need to be assessed.

Should I conduct a local replication whenever the evidence comes from another country?

Not automatically. A replication is most informative when there is a substantive reason to expect the result may differ or when the local parameter itself is important and unknown. Geographic difference alone is not sufficient justification.

What if international and local evidence point in different directions?

Compare their methodological credibility and investigate population, measurement, implementation, baseline, and contextual differences. The disagreement may be informative, but it should not be resolved simply by privileging either the larger or the geographically closer evidence base.

09 · The Bottom Line

Strong international evidence can travel, but local facts do not arrive with it

The Bottom Line

Strong international evidence can compensate for limited local research when the broader finding is credible and there is no important reason to expect it to operate differently in your setting, but it cannot replace local information that is inherently needed to understand conditions, feasibility, implementation, or expected absolute impact.

Do not ask simply whether you have enough local studies. Ask what remains locally uncertain, whether that uncertainty could change your conclusion, and what kind of local evidence would actually resolve it.

10 · Sources and Further Reading

Sources and further reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes