Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Where Is There Simply No Evidence in the Existing Literature?

Finding no evidence is a much stronger claim than finding weak evidence. Learn how to verify an apparently empty literature and decide whether the absence represents a meaningful research gap.

750
Where There Is No Evidence Guide 750 of 899
01 · The Question

Where Does the Evidence Map Become Genuinely Empty?

Some literature gaps are not disagreements, methodological weaknesses, or questions with only a handful of studies. Sometimes a sufficiently careful search identifies no eligible evidence addressing the question at all.

That sounds straightforward until you try to establish it. Did researchers truly never investigate the question, or did your search miss their terminology? Does relevant work exist in another discipline, language, database, or publication type? Did studies examine the broader problem but fail your narrowly defined eligibility criteria? Has the question been studied indirectly even though no study answers it directly?

“There is no evidence” is therefore one of the strongest claims you can make about a literature. It should be bounded by the question, eligibility criteria, sources searched, and search date rather than presented as an unrestricted statement about everything researchers have ever done.

02 · The Short Answer

No Evidence Means No Eligible Evidence Was Identified for a Defined Question

In Brief

You can reasonably identify an area as having no evidence when a sufficiently comprehensive, transparent, and appropriately scoped search finds no eligible studies that directly provide evidence for the defined research question.

Prefer bounded language such as “no eligible studies were identified within the defined search scope” over absolute claims that “no research exists.” An empty evidence base also does not establish that an intervention has no effect, that a relationship does not exist, or that conducting the missing study would necessarily be worthwhile.

03 · What You Need to Know

How to Establish That an Evidence Gap Is Actually Empty

Distinguish No Evidence From Weak Evidence

A question with poor-quality studies does not have no evidence. A question with three imprecise studies does not have no evidence. A question with contradictory studies certainly does not have no evidence.

No identified evidence No eligible studies directly addressing the defined question were found within the search scope.
Weak evidence Relevant evidence exists, but important limitations reduce confidence in what it supports.

This distinction matters because the research implications are different. If evidence exists but remains weak, the next study should address the weaknesses already visible in that evidence. If no eligible evidence exists, researchers may need to build the evidential foundation from much earlier in the process.

Distinguish No Evidence From Barely Addressed

The boundary between sparse and absent evidence should also remain clear.

If two directly relevant studies exist but are small or preliminary, the question has been barely addressed. If no eligible study directly addresses the question, you may have an empty evidence cell.

Do not erase the few studies that exist simply because they are inconveniently small. “Almost no evidence” and “no evidence” are different statements.

Your Claim of Absence Is Only as Good as Your Search

A database returning zero results tells you something about that search query in that database. It does not establish that the global literature contains no relevant evidence.

Before making a strong absence claim, consider whether your search adequately covers:

  • the major databases relevant to the discipline;
  • alternative names and synonyms for the central concepts;
  • older and newer terminology;
  • spelling and language variations where relevant;
  • neighboring disciplines that may study the same phenomenon differently;
  • citation searching from closely related literature;
  • grey literature when appropriate to the question; and
  • the publication period necessary for the research problem.

JBI guidance for scoping reviews emphasizes comprehensive searching appropriate to the review objective and transparent reporting of the search process. Scoping approaches can be particularly useful when the purpose is to determine the extent and nature of evidence rather than estimate one narrowly defined effect.

Watch Out

“My search found nothing” is not yet equivalent to “the literature contains no evidence.” Before turning zero search results into the central justification for a study, try hard to prove yourself wrong.

Define the Evidence Cell Before Declaring It Empty

No evidence about what, exactly?

An evidence gap becomes meaningful only when its boundaries are explicit. Depending on the research question, specify relevant elements such as:

  • population;
  • intervention, exposure, predictor, or phenomenon;
  • comparison, when applicable;
  • outcome;
  • setting or context;
  • time frame;
  • study design where design is genuinely part of the question; and
  • the type of claim the evidence would need to support.

Evidence and gap maps formalize this logic by mapping existing studies across predefined dimensions so that areas with concentrations of evidence and areas with little or no evidence become visible.

The more precisely you define the empty cell, the more defensible the claim becomes. “No research exists on digital learning” is almost certainly indefensible. “No eligible studies were identified evaluating long-term outcome X for population Y under condition Z within the databases and dates searched” is a claim that can actually be examined.

An Empty Review Does Not Mean Nothing Related Has Ever Been Published

Systematic reviews that contain no included studies are often called empty reviews. Research examining Cochrane reviews has shown that an empty review may still have excluded studies, ongoing studies, or studies awaiting assessment. A review can therefore be empty because nothing satisfies its eligibility criteria even though adjacent literature exists.

This distinction is essential. Perhaps relevant studies use an ineligible design. Perhaps they examine a related population. Perhaps they measure a different outcome. Perhaps the review question is exceptionally narrow.

When you find no eligible studies, inspect what was excluded and why. The pattern of exclusion can reveal whether the underlying field is genuinely untouched or whether your precise question lies just beyond an existing body of research.

Check Whether Your Question Is Artificially Narrow

You can manufacture an empty literature by adding enough restrictions.

Imagine requiring a particular intervention, one age range, one country, one outcome, one instrument, a narrow publication period, and one study design. Eventually, almost any literature can be reduced to zero.

Research on empty systematic reviews has identified highly specific questions and stringent methodological eligibility criteria as possible reasons reviews contain no eligible studies.

Ask whether every restriction is scientifically necessary. If removing a restriction changes the research question into something less interesting, keep it. If the restriction exists only to manufacture novelty, the resulting gap is technically empty but intellectually rather crowded with problems.

Absence of Evidence Does Not Automatically Establish Evidence of No Effect

This distinction is especially important when the question concerns an effect, association, difference, or intervention.

If no eligible studies examine whether intervention X reduces outcome Y, you cannot conclude from that absence that intervention X has no effect on Y. You simply lack direct eligible evidence capable of answering the question.

The same caution applies when studies exist but their estimates are too imprecise to exclude meaningful effects. Methodological discussions in the medical literature have long emphasized the danger of interpreting a failure to establish a difference as proof that no meaningful difference exists.

Absence of evidence The available evidence does not establish whether the phenomenon, relationship, difference, or effect is present.
Evidence supporting absence Appropriately informative evidence supports the conclusion that a meaningful phenomenon, relationship, difference, or effect is absent or sufficiently small within specified bounds.

Those are fundamentally different evidential states.

No Evidence Does Not Mean No Knowledge

A narrowly defined question may have no direct evidence while related knowledge still informs what is plausible.

Perhaps no study directly tests an intervention in a particular population, but evidence exists about the intervention elsewhere. Perhaps no study measures the desired long-term outcome, but short-term mechanisms have been investigated. Perhaps theory provides reasons to anticipate an effect even though direct empirical testing is absent.

Keep direct evidence and indirect knowledge separate. Related evidence can help justify a study or formulate hypotheses, but it should not be silently relabeled as direct evidence for the unanswered question.

No Evidence Can Occur at an Intersection

An entire topic does not need to be unexplored for an evidence cell to be empty.

For example, a literature may contain:

  • extensive evidence about population A but none for population B;
  • many short-term studies but no long-term evidence;
  • numerous studies of benefits but none measuring a consequential harm;
  • many observational studies but no evidence capable of addressing a particular intervention-effect question; or
  • extensive research on an outcome but none in a particular implementation context.

This is why earlier mapping of missing populations, missing methodological capabilities, and neglected outcomes can reveal precise intersections where no direct evidence remains.

An Empty Evidence Cell Is Not Automatically an Important Gap

Perhaps nobody has studied the effect of a particular intervention on an obscure outcome in an implausibly narrow population because there is little scientific reason to do so.

Evidence and gap mapping can identify empty areas, but prioritizing research requires another judgment. Ask:

  • Would answering the question change theoretical understanding?
  • Would it influence an important decision?
  • Is the population meaningfully affected?
  • Would it test a plausible mechanism or boundary condition?
  • Could the answer alter practice, policy, design, or future research?
  • Is the study feasible and ethically defensible?

An empty cell tells you that evidence is missing. It does not tell you automatically that the missing evidence deserves to exist.

Sometimes the Most Useful Result Is Knowing That the Evidence Is Absent

A well-conducted review that identifies no eligible studies is not necessarily a failed review. It can reveal that decisions are being made without direct research evidence, expose assumptions that have not been empirically tested, or establish a baseline for future work.

Research on empty Cochrane reviews has documented that systematic reviews can legitimately end with no eligible included studies. The challenge is to avoid overreaching from that absence into unsupported recommendations.

The defensible conclusion may simply be: the search identified no eligible evidence capable of answering the question. Sometimes intellectual honesty produces a remarkably short results section.

Record the Search Date Because “No Evidence” Can Expire

Evidence gaps are time-sensitive. A search conducted today may identify nothing, while a trial, dissertation, dataset, or journal article appearing next month changes the classification.

For claims of absence, recording the final search date is particularly useful. It makes clear that the statement describes the evidence available within a defined search window rather than claiming permanent emptiness.

04 · A Practical Example

When a Large Literature Contains One Completely Empty Cell

Hypothetical Example

An Extensively Studied Intervention With No Long-Term Evidence for One Population

Imagine reviewing a hypothetical educational intervention with more than 100 published studies.

Map the existing evidence Most studies involve university students and measure immediate academic performance. Several studies involve secondary-school students.
Specify the question You want to know whether the intervention improves independent performance one year later among primary-school pupils.
Search broadly You search relevant educational and multidisciplinary databases using alternative intervention terms, population terminology, outcome synonyms, citation searching, and appropriate grey-literature sources.
Inspect near misses You find studies involving primary-school pupils, but none measures the one-year outcome. You also find long-term studies, but all involve older students.
Defensible conclusion No eligible evidence was identified for the specific combination of primary-school learners and one-year independent performance within the defined search scope.
Next question You now ask whether developmental differences and the importance of durable independent performance make this empty evidence cell consequential enough to justify a new study.

The general topic is heavily researched. The specific question is not. Mapping the intersection prevents both exaggerations: claiming the entire field is unexplored and pretending that abundant neighboring research directly answers the empty question.

05 · What Researchers Often Get Wrong

Common Mistakes When Claiming That No Evidence Exists

Misconception

Zero Results in One Database Means No Research Exists

No. Database coverage, indexing, terminology, language, publication type, and search construction can all determine what you retrieve. An absence claim should reflect a search strategy capable of supporting it.

Misconception

No Eligible Studies Means Nothing Related Has Ever Been Studied

An empty review can still contain many excluded studies. Explain why related evidence does not directly answer the defined question rather than pretending the surrounding literature is empty.

Misconception

No Evidence Means the Intervention Does Not Work

No. Without informative evidence, you generally cannot establish either meaningful benefit or meaningful absence of benefit. Lack of evidence for an effect is not automatically evidence establishing no effect.

Misconception

No Evidence Automatically Creates a Strong Research Gap

Absence establishes that evidence is missing, not that obtaining it would be important. Explain what consequential uncertainty the missing evidence creates and why resolving it matters.

Misconception

The Narrower My Question, the Stronger My Novelty

Excessive restrictions can manufacture an empty literature. Every population, outcome, context, date, and design restriction should have a substantive reason rather than merely helping the search reach zero.

Misconception

If No Study Directly Answers the Question, Related Evidence Is Irrelevant

Related evidence can inform plausibility, theory, feasibility, measurement, study design, and hypotheses. It should simply be distinguished from direct evidence capable of answering the precise question.

06 · What This Means for You

Treat an Empty Evidence Base as Something to Verify Before You Try to Fill It

If your review appears to reveal no evidence, challenge the conclusion first. Then decide whether the absence identifies a worthwhile research problem.

A simple decision framework

If an initial search retrieves nothing
Expand terminology, databases, disciplinary perspectives, citation searching, and relevant evidence sources before making an absence claim.
If related studies exist but fail one eligibility criterion
Examine whether that criterion is substantively necessary and describe the surrounding evidence accurately.
If a few directly relevant studies exist
Classify the question as sparsely or barely addressed rather than claiming there is no evidence.
If no eligible evidence remains after a credible search
State the absence within the boundaries of the search and resist drawing conclusions the missing evidence cannot support.
If the empty evidence cell concerns an important unresolved decision or scientific question
Consider whether primary research could provide the foundational evidence needed.
If the cell is empty only because the question is excessively narrow or inconsequential
Do not mistake technical novelty for a meaningful research contribution.

The strongest justification is not “nobody has studied this.” It is: no eligible direct evidence was identified, the missing evidence leaves this consequential question unresolved, and there is a defensible reason to resolve it.

07 · A Quick Checklist

Before Claiming That There Is No Evidence

Verify the empty evidence cell:
Have I defined exactly which research question or evidence cell appears empty?
Have I searched appropriate databases for the disciplines involved?
Have I used synonyms, alternative terminology, and older or neighboring disciplinary language where relevant?
Have I considered citation searching, grey literature, regional sources, or other evidence sources where appropriate?
Have I inspected excluded or near-eligible studies to understand why they do not answer the question?
Are my eligibility criteria scientifically justified rather than unnecessarily narrow?
Have I distinguished no evidence from weak, sparse, indirect, or contradictory evidence?
Am I using bounded wording rather than claiming universally that “no research exists”?
Have I recorded when the search was last conducted?
Can I explain why filling this empty evidence cell would materially improve knowledge or decision-making?
08 · Frequently Asked Questions

Questions About Areas With No Research Evidence

Can I say “no studies exist” if my search finds nothing?

Usually it is safer and more accurate to state that no eligible studies were identified within the defined search scope and date. Absolute claims require unusually strong assurance that relevant evidence has not been missed.

What is an empty systematic review?

An empty review is a systematic review in which no studies meet the eligibility criteria for inclusion. Related or excluded studies may still exist, so an empty review does not necessarily mean that nothing has ever been published on the broader topic.

Does no evidence mean there is no effect?

No. If no informative evidence exists, the effect generally remains unknown. Evidence supporting no meaningful effect requires appropriately designed and sufficiently informative research capable of supporting that conclusion.

What is the difference between no evidence and weak evidence?

No evidence means no eligible direct evidence was identified for the defined question. Weak evidence means relevant studies exist, but their collective limitations prevent high confidence in the answer.

What if only one or two studies exist?

Then the evidence is not absent. Describe the question as sparsely or barely addressed and evaluate what those studies can and cannot establish.

Is an empty area in an evidence map automatically a research priority?

No. An empty cell identifies missing evidence. Research priority also depends on whether the question matters, whether resolving it could change understanding or decisions, and whether useful research is feasible.

Can related evidence still be useful when no direct studies exist?

Yes. Indirect evidence can inform theory, plausibility, feasibility, measurement, and study design. Keep it clearly distinguished from direct evidence capable of answering the specific question.

Can a claim of no evidence become outdated?

Yes. New studies can fill an evidence gap at any time. Record the search date and verify the literature again when the claim is used later, especially in rapidly developing fields.

09 · The Bottom Line

No Evidence Is a Bounded Finding, Not Permission to Conclude Whatever Comes Next

The Bottom Line

You can reasonably identify an area as having no evidence when a sufficiently comprehensive and transparent search finds no eligible studies directly addressing a clearly defined question, but the conclusion should remain bounded by the search scope, eligibility criteria, and date.

An empty evidence cell tells you that the answer is not available from the eligible literature. It does not tell you what the answer would be, nor whether the missing study is automatically worth conducting. The final step is to ask whether resolving that absence would actually matter.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes