When Is “There Is Very Little Evidence” the Most Important Finding?

What if the most important result is how little research exists?

Researchers often begin a review expecting to synthesize findings. They imagine tables of study characteristics, comparisons among results, perhaps a meta-analysis, and eventually a conclusion about what the evidence shows.

Then the search produces almost nothing.

Perhaps only two studies meet the eligibility criteria. Perhaps none do. After checking the search strategy, tracing references, examining relevant grey literature, and reconsidering whether the eligibility criteria are unnecessarily restrictive, the evidence base remains sparse.

That can feel like an unsuccessful review because the anticipated synthesis never materializes. Yet for an important and answerable question, establishing that little or no directly relevant evidence exists may itself be a consequential finding.

The challenge is knowing when evidence scarcity genuinely tells us something about the state of knowledge and when it merely reflects a search, scope, or methodological problem.

Evidence scarcity matters when you have established it rather than merely encountered it

An evidence gap is a finding only after you establish that the gap is real

Finding few studies during an initial search does not by itself establish that little evidence exists. Relevant studies may use unexpected terminology, appear in databases you did not search, remain unpublished, sit in grey literature, or have been excluded by criteria narrower than the substantive question requires.

Before treating scarcity as the main finding, you therefore need confidence that the review process was capable of detecting the evidence you claim is scarce.

This is why the general response to finding only a few relevant studies begins with checking the search and eligibility decisions rather than immediately announcing a research gap.

Zero studies and very few studies are related but different situations

A systematic review with no studies meeting its inclusion criteria is sometimes called an “empty review.” Empty reviews are not merely hypothetical. An analysis of the Cochrane Database of Systematic Reviews using records available in August 2010 identified 376 active reviews with no included studies, representing 8.7% of active reviews at that time. That historical figure should not be interpreted as the current prevalence of empty reviews, but it demonstrates that rigorously conducted reviews can end with no eligible studies at all.

PRISMA 2020 is applicable to systematic reviews that do not contain a statistical synthesis, including situations in which only one eligible study is identified. The absence of a meta-analysis therefore does not by itself make a systematic review incomplete or methodologically unsuccessful.

Both can expose evidence gaps, but the interpretation differs. An empty review cannot estimate an effect from included studies because there are none. A sparse review may provide some direct evidence while leaving substantial uncertainty.

The importance of the gap depends partly on the importance of the question

Not every absence of research deserves equal attention.

If almost no studies address a trivial, obsolete, or poorly formulated question, the scarcity may have little practical significance. Conversely, very little evidence about a widely used intervention, a consequential policy, a vulnerable population, a potentially serious harm, or a common professional practice may reveal a meaningful mismatch between decisions being made and evidence available to inform them.

This is an important distinction because “no one has studied this” is not automatically a research justification. Sometimes no one has studied something because the question is not especially useful.

A meaningful evidence gap therefore requires two judgments: the evidence is genuinely scarce, and resolving the uncertainty would matter.

Be precise about what is actually missing

“There is little research on this topic” is usually too broad to be useful.

The gap may instead concern a specific population, intervention, comparator, outcome, context, study design, follow-up period, or combination of these.

Perhaps dozens of studies examine an intervention, but almost none involve older adults. Perhaps effectiveness is well studied, while harms are poorly reported. Perhaps short-term outcomes are abundant but long-term outcomes are missing. Perhaps quantitative studies exist, but little qualitative research addresses why implementation succeeds in some settings and fails in others.

A precise gap is more informative than a dramatic one.

“No evidence” must not become “evidence of no effect”

This is the most important interpretive boundary.

If no eligible study evaluates whether an intervention reduces an outcome, the review cannot conclude that the intervention does not reduce that outcome. It also cannot conclude that the intervention does reduce it.

The evidence simply does not answer the question.

The same distinction applies when a few highly imprecise studies exist. As discussed when drawing conclusions from only a few studies, failure to demonstrate an effect is not automatically evidence demonstrating no effect.

These statements may sound similar in casual conversation. Scientifically, they describe fundamentally different states of knowledge.

A gap can remain important even when indirect evidence exists

Suppose no study directly addresses your target population, but several studies examine a related population. Or perhaps no study measures the target outcome, but several report a surrogate.

The literature is no longer empty in a broad sense. The direct evidence gap may nevertheless remain.

This is why attempts to broaden the population, broaden the outcomes, or include related conditions, interventions, or contexts should not make the original gap disappear rhetorically.

Indirect evidence can reduce uncertainty. It does not retroactively create direct studies.

Searching grey literature can determine whether the apparent gap survives scrutiny

Before declaring that little evidence exists, consider whether unpublished or difficult-to-locate research could materially change that conclusion.

Study registries, dissertations, conference materials, government reports, regulatory sources, institutional repositories, and other grey literature can be particularly important when conventional databases identify very few studies. Cochrane notes that unpublished studies may have greater potential to influence conclusions when only a few relevant studies exist.

An appropriately targeted search for grey literature when evidence is scarce therefore strengthens the basis for claiming that scarcity reflects the research record rather than simply the publication record.

An empty review still tells you what was searched for and not found

A review with no included studies cannot provide a conventional synthesis of included-study results. It can, however, define an unresolved question, document the methods used to look for evidence, show which apparently relevant studies failed to meet eligibility criteria, identify ongoing research where applicable, and prevent future researchers from repeatedly assuming that a supporting evidence base already exists.

Cochrane guidance developed for reporting empty reviews also cautions against using results from excluded studies as though they answered the review question. Studies that failed the eligibility criteria may help explain the surrounding literature, but their exclusion has methodological meaning.

An evidence gap does not automatically justify a new study

This point is easy to overlook.

A review may establish that direct evidence is scarce without establishing that another study should necessarily be conducted. Research has costs, opportunity costs, and sometimes burdens or risks for participants. A new study becomes more compelling when the unresolved question matters and additional evidence could plausibly change understanding, practice, policy, or future decisions.

The design of future research should also respond to the actual gap. If existing studies are all small and imprecise, more adequately powered research may be useful. If the problem is persistent risk of bias, another study using the same weak design may add little. If the missing evidence concerns a particular population or outcome, future work should address that absence rather than merely adding another study somewhere nearby.

The absence of evidence can expose assumptions embedded in current practice

An especially consequential evidence gap occurs when an intervention, policy, or practice is already widely used despite little direct research addressing its important benefits or harms.

A review cannot infer from scarcity that the practice is ineffective or inappropriate. It can establish something different: the confidence with which claims about that practice can be made is constrained by the available evidence.

That distinction may be highly relevant to researchers and decision-makers because it separates what has become customary from what has actually been studied.

Sometimes the headline finding is therefore not “X works” or “X does not work.” It is “We do not yet have adequate evidence to know.”

When three studies are more important for what they do not answer

The precision of that conclusion matters. It tells future researchers exactly what is missing while avoiding the false impression that the entire topic is unexplored.

A research gap can be overstated just as easily as a research finding

Turn scarcity into a precise statement about what remains unknown

If very little evidence survives a rigorous search, resist the urge to treat that outcome as an embarrassment. Instead, determine exactly what the scarcity establishes.

The central discipline is specificity. “There is little evidence” should almost always be followed mentally by: evidence about what, in whom, for which outcome, under what conditions, and according to which eligible designs?

Once those boundaries are clear, scarcity becomes interpretable rather than merely disappointing.

Before presenting evidence scarcity as a major finding

Questions about treating lack of evidence as a finding

Sometimes what we do not know is the result

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.