01 · The Question
Where Does the Evidence Map Become Genuinely Empty?
Some literature gaps are not disagreements, methodological weaknesses, or questions with only a handful of studies. Sometimes a sufficiently careful search identifies no eligible evidence addressing the question at all.
That sounds straightforward until you try to establish it. Did researchers truly never investigate the question, or did your search miss their terminology? Does relevant work exist in another discipline, language, database, or publication type? Did studies examine the broader problem but fail your narrowly defined eligibility criteria? Has the question been studied indirectly even though no study answers it directly?
“There is no evidence” is therefore one of the strongest claims you can make about a literature. It should be bounded by the question, eligibility criteria, sources searched, and search date rather than presented as an unrestricted statement about everything researchers have ever done.
03 · What You Need to Know
How to Establish That an Evidence Gap Is Actually Empty
Distinguish No Evidence From Weak Evidence
A question with poor-quality studies does not have no evidence. A question with three imprecise studies does not have no evidence. A question with contradictory studies certainly does not have no evidence.
No identified evidence
No eligible studies directly addressing the defined question were found within the search scope.
Weak evidence
Relevant evidence exists, but important limitations reduce confidence in what it supports.
This distinction matters because the research implications are different. If evidence exists but remains weak, the next study should address the weaknesses already visible in that evidence. If no eligible evidence exists, researchers may need to build the evidential foundation from much earlier in the process.
Distinguish No Evidence From Barely Addressed
The boundary between sparse and absent evidence should also remain clear.
If two directly relevant studies exist but are small or preliminary, the question has been barely addressed. If no eligible study directly addresses the question, you may have an empty evidence cell.
Do not erase the few studies that exist simply because they are inconveniently small. “Almost no evidence” and “no evidence” are different statements.
Your Claim of Absence Is Only as Good as Your Search
A database returning zero results tells you something about that search query in that database. It does not establish that the global literature contains no relevant evidence.
Before making a strong absence claim, consider whether your search adequately covers:
- the major databases relevant to the discipline;
- alternative names and synonyms for the central concepts;
- older and newer terminology;
- spelling and language variations where relevant;
- neighboring disciplines that may study the same phenomenon differently;
- citation searching from closely related literature;
- grey literature when appropriate to the question; and
- the publication period necessary for the research problem.
JBI guidance for scoping reviews emphasizes comprehensive searching appropriate to the review objective and transparent reporting of the search process. Scoping approaches can be particularly useful when the purpose is to determine the extent and nature of evidence rather than estimate one narrowly defined effect.
Watch Out
“My search found nothing” is not yet equivalent to “the literature contains no evidence.” Before turning zero search results into the central justification for a study, try hard to prove yourself wrong.
Define the Evidence Cell Before Declaring It Empty
No evidence about what, exactly?
An evidence gap becomes meaningful only when its boundaries are explicit. Depending on the research question, specify relevant elements such as:
- population;
- intervention, exposure, predictor, or phenomenon;
- comparison, when applicable;
- outcome;
- setting or context;
- time frame;
- study design where design is genuinely part of the question; and
- the type of claim the evidence would need to support.
Evidence and gap maps formalize this logic by mapping existing studies across predefined dimensions so that areas with concentrations of evidence and areas with little or no evidence become visible.
The more precisely you define the empty cell, the more defensible the claim becomes. “No research exists on digital learning” is almost certainly indefensible. “No eligible studies were identified evaluating long-term outcome X for population Y under condition Z within the databases and dates searched” is a claim that can actually be examined.
An Empty Review Does Not Mean Nothing Related Has Ever Been Published
Systematic reviews that contain no included studies are often called empty reviews. Research examining Cochrane reviews has shown that an empty review may still have excluded studies, ongoing studies, or studies awaiting assessment. A review can therefore be empty because nothing satisfies its eligibility criteria even though adjacent literature exists.
This distinction is essential. Perhaps relevant studies use an ineligible design. Perhaps they examine a related population. Perhaps they measure a different outcome. Perhaps the review question is exceptionally narrow.
When you find no eligible studies, inspect what was excluded and why. The pattern of exclusion can reveal whether the underlying field is genuinely untouched or whether your precise question lies just beyond an existing body of research.
Check Whether Your Question Is Artificially Narrow
You can manufacture an empty literature by adding enough restrictions.
Imagine requiring a particular intervention, one age range, one country, one outcome, one instrument, a narrow publication period, and one study design. Eventually, almost any literature can be reduced to zero.
Research on empty systematic reviews has identified highly specific questions and stringent methodological eligibility criteria as possible reasons reviews contain no eligible studies.
Ask whether every restriction is scientifically necessary. If removing a restriction changes the research question into something less interesting, keep it. If the restriction exists only to manufacture novelty, the resulting gap is technically empty but intellectually rather crowded with problems.
Absence of Evidence Does Not Automatically Establish Evidence of No Effect
This distinction is especially important when the question concerns an effect, association, difference, or intervention.
If no eligible studies examine whether intervention X reduces outcome Y, you cannot conclude from that absence that intervention X has no effect on Y. You simply lack direct eligible evidence capable of answering the question.
The same caution applies when studies exist but their estimates are too imprecise to exclude meaningful effects. Methodological discussions in the medical literature have long emphasized the danger of interpreting a failure to establish a difference as proof that no meaningful difference exists.
Absence of evidence
The available evidence does not establish whether the phenomenon, relationship, difference, or effect is present.
Evidence supporting absence
Appropriately informative evidence supports the conclusion that a meaningful phenomenon, relationship, difference, or effect is absent or sufficiently small within specified bounds.
Those are fundamentally different evidential states.
No Evidence Does Not Mean No Knowledge
A narrowly defined question may have no direct evidence while related knowledge still informs what is plausible.
Perhaps no study directly tests an intervention in a particular population, but evidence exists about the intervention elsewhere. Perhaps no study measures the desired long-term outcome, but short-term mechanisms have been investigated. Perhaps theory provides reasons to anticipate an effect even though direct empirical testing is absent.
Keep direct evidence and indirect knowledge separate. Related evidence can help justify a study or formulate hypotheses, but it should not be silently relabeled as direct evidence for the unanswered question.
No Evidence Can Occur at an Intersection
An entire topic does not need to be unexplored for an evidence cell to be empty.
For example, a literature may contain:
- extensive evidence about population A but none for population B;
- many short-term studies but no long-term evidence;
- numerous studies of benefits but none measuring a consequential harm;
- many observational studies but no evidence capable of addressing a particular intervention-effect question; or
- extensive research on an outcome but none in a particular implementation context.
This is why earlier mapping of missing populations, missing methodological capabilities, and neglected outcomes can reveal precise intersections where no direct evidence remains.
An Empty Evidence Cell Is Not Automatically an Important Gap
Perhaps nobody has studied the effect of a particular intervention on an obscure outcome in an implausibly narrow population because there is little scientific reason to do so.
Evidence and gap mapping can identify empty areas, but prioritizing research requires another judgment. Ask:
- Would answering the question change theoretical understanding?
- Would it influence an important decision?
- Is the population meaningfully affected?
- Would it test a plausible mechanism or boundary condition?
- Could the answer alter practice, policy, design, or future research?
- Is the study feasible and ethically defensible?
An empty cell tells you that evidence is missing. It does not tell you automatically that the missing evidence deserves to exist.
Sometimes the Most Useful Result Is Knowing That the Evidence Is Absent
A well-conducted review that identifies no eligible studies is not necessarily a failed review. It can reveal that decisions are being made without direct research evidence, expose assumptions that have not been empirically tested, or establish a baseline for future work.
Research on empty Cochrane reviews has documented that systematic reviews can legitimately end with no eligible included studies. The challenge is to avoid overreaching from that absence into unsupported recommendations.
The defensible conclusion may simply be: the search identified no eligible evidence capable of answering the question. Sometimes intellectual honesty produces a remarkably short results section.
Record the Search Date Because “No Evidence” Can Expire
Evidence gaps are time-sensitive. A search conducted today may identify nothing, while a trial, dissertation, dataset, or journal article appearing next month changes the classification.
For claims of absence, recording the final search date is particularly useful. It makes clear that the statement describes the evidence available within a defined search window rather than claiming permanent emptiness.
07 · A Quick Checklist
Before Claiming That There Is No Evidence
Verify the empty evidence cell:
Have I defined exactly which research question or evidence cell appears empty?
Have I searched appropriate databases for the disciplines involved?
Have I used synonyms, alternative terminology, and older or neighboring disciplinary language where relevant?
Have I considered citation searching, grey literature, regional sources, or other evidence sources where appropriate?
Have I inspected excluded or near-eligible studies to understand why they do not answer the question?
Are my eligibility criteria scientifically justified rather than unnecessarily narrow?
Have I distinguished no evidence from weak, sparse, indirect, or contradictory evidence?
Am I using bounded wording rather than claiming universally that “no research exists”?
Have I recorded when the search was last conducted?
Can I explain why filling this empty evidence cell would materially improve knowledge or decision-making?