Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Do You Know Whether Existing Reviews Already Answer the Question?

Finding a review on your topic does not necessarily mean your question has already been answered. Compare the actual questions, scope, evidence, methods, and applicability before deciding.

712
Do Existing Reviews Answer the Question? Guide 712 of 899
01 · The Question

Finding a Review on Your Topic Is Only the Beginning

You search for literature related to your proposed review and find several systematic reviews with titles that look uncomfortably close to yours. At this point, it is tempting to conclude that somebody has already answered your question.

But similarity of topic is not the same as equivalence of question.

An existing review may examine a different population, intervention or phenomenon, comparison, outcome, setting, study design, or period of evidence. It may also appear to match your question but contain methodological limitations that affect how confidently its conclusions can be used.

Before deciding that your planned review is redundant, you need to compare what you want to know with what the existing reviews actually established.

02 · The Short Answer

Compare Questions and Evidence, Not Just Titles

In Brief

An existing review already answers your question when its review question and scope sufficiently match yours, its search captures the relevant evidence, its methods support a trustworthy synthesis, and its findings remain applicable to the decision or uncertainty you want to address.

You rarely determine this from the title or abstract alone. Examine the review's eligibility criteria, search dates and methods, included studies, outcomes, synthesis, limitations, and conclusions before deciding that the question has been adequately answered.

03 · What You Need to Know

How to Test Whether an Existing Review Really Answers Your Question

Begin by writing your question independently

Before comparing your proposed review with existing reviews, state your intended question clearly. Otherwise, there is a subtle risk of reshaping your question after seeing what others have already reviewed.

The relevant elements depend on the type of review. For intervention questions, these often include the population, intervention, comparator, and outcomes. Other review questions may instead be structured around exposures, phenomena, concepts, contexts, diagnostic questions, experiences, or other dimensions.

Cochrane emphasizes that a well-formulated review question guides eligibility criteria, searching, data collection, synthesis, and presentation. It also recommends identifying related or overlapping reviews before beginning a new review so that unnecessary duplication can be reduced.

Once your own question is explicit, you have something concrete against which existing reviews can be compared.

Separate a shared topic from a shared question

Suppose your proposed question concerns whether generative AI-supported feedback improves undergraduate students' academic writing. You find a systematic review titled “Artificial Intelligence in Higher Education.” The topical overlap is obvious, but the title tells you almost nothing about whether your specific question has been answered.

The review might concentrate on attitudes toward AI. It might include every form of artificial intelligence but provide little evidence about feedback. It might combine school, university, and professional education. It might examine adoption rather than learning outcomes.

Same topic The review covers the same broad area of research.
Same question The review investigates sufficiently similar relationships, populations, outcomes, contexts, and other dimensions needed to address your intended uncertainty.

The distinction is fundamental. A crowded topic can still contain unanswered questions, while a narrowly defined question may already have been comprehensively synthesized.

Compare the eligibility criteria element by element

The inclusion and exclusion criteria usually reveal the operational meaning of the review question more precisely than its title.

Construct a comparison between your proposed criteria and those of the closest existing reviews. Depending on the question, examine population, intervention or exposure, comparator, outcome, context, study design, publication period, language restrictions, and other substantive boundaries.

Element Your proposed review Existing review Question to ask
Population Your intended participants Included participants Would the difference materially affect applicability?
Phenomenon or intervention Your exact focus What was actually eligible Does the existing review contain the evidence you need?
Outcome What you need to understand Outcomes synthesized Was your outcome actually analyzed?
Context Your intended setting Settings represented Is contextual transfer reasonable?
Study design Designs relevant to your question Eligible designs Was relevant evidence excluded by design?

Not every mismatch creates a review gap. The question is whether the difference changes what can reasonably be concluded.

Check what evidence the review could actually have found

A review may ask almost exactly your question yet still fail to contain the evidence needed to answer it adequately.

Inspect the databases and other information sources searched, the search strategy where available, restrictions applied, and the date of the final search. Also examine whether relevant studies you already know about appear among the included studies.

A recent publication date does not guarantee a recent or adequate search. Conversely, an older review may remain informative if little consequential evidence has appeared since its search.

If a seemingly relevant review searched inadequately, its recency alone should not persuade you that the question is settled. A recent review can still leave an evidence gap when its search was poor.

Determine whether the methods support the answer

A review can address the right question and still provide an unreliable answer.

Methodological appraisal therefore matters. Depending on the type of review, consider whether study selection and data extraction were appropriately conducted, risk of bias was assessed, synthesis methods suited the data, heterogeneity was handled appropriately, and limitations of the evidence influenced the interpretation.

Tools can assist with this appraisal when they fit the review type. AMSTAR 2, for example, was developed to critically appraise systematic reviews of healthcare interventions that include randomized or non-randomized studies. ROBIS instead focuses specifically on risk of bias in systematic reviews and has broader applicability across several types of review questions. These tools overlap, but they do not assess exactly the same construct.

Watch Out

Do not apply an appraisal instrument merely because it is familiar. Check whether the tool was designed for the type of review you are evaluating. AMSTAR 2, for example, is not a generic quality checklist for every possible form of evidence synthesis.

Read the results, not merely the authors' conclusion

Authors may conclude that an intervention “appears effective,” that evidence is “promising,” or that further research is required. Those statements are interpretations. You need to understand what evidence produced them.

Look at the number and characteristics of included studies, consistency of findings, precision where relevant, risk of bias, heterogeneity, and any limitations affecting certainty or applicability.

A review can technically address your question while still leaving substantial uncertainty. In that situation, the question has been reviewed, but it may not have been conclusively answered.

Ask whether the answer applies to your intended context

Sometimes the evidence is reasonably complete for one population or context but uncertain for another. That does not mean every demographic, institution, profession, or country deserves its own systematic review.

Instead, identify a credible reason why the distinction could affect the evidence or its interpretation. If your proposed review differs mainly by population, examine whether the population difference could meaningfully change the answer.

The same caution applies geographically. The fact that no review has been published specifically for your country does not itself demonstrate that evidence synthesized elsewhere is inapplicable.

Determine whether the evidence base has changed

Even a rigorous review can become incomplete when consequential new evidence appears.

Do not merely count publications appearing after the previous search. Examine whether they are eligible, how much evidence they contribute, whether they address previous weaknesses, and whether their findings could alter interpretation.

A particularly influential new study may sometimes warrant reconsideration of an existing synthesis. The relevant question is whether the new study could materially change what the review currently tells us, not simply whether it is large or highly visible.

Distinguish “answered” from “reviewed”

This is perhaps the most useful distinction.

The question has been reviewed A previous evidence synthesis investigated substantially the same question.
The question is adequately answered The available synthesis contains sufficiently relevant and current evidence, uses methods appropriate to the question, and supports conclusions useful for the uncertainty or decision at hand.

A question can therefore be reviewed repeatedly while remaining uncertain. Equally, a single rigorous and current review may already provide a sufficient synthesis.

PRISMA 2020 reflects this logic. When similar systematic reviews already exist, authors are expected to explain why another review was considered necessary, with examples including outdated reviews, discordant results, methodological flaws, or newer review methods capable of addressing the question differently.

04 · A Practical Example

Three Reviews on the Topic, but Do They Answer the Question?

Hypothetical Example

Evaluating a proposed review of AI-supported feedback

A researcher wants to review whether AI-generated formative feedback improves academic writing among undergraduate students. A preliminary search finds three systematic reviews involving artificial intelligence and higher education.

Review A Includes university students and artificial intelligence technologies but examines acceptance, attitudes, and adoption rather than academic writing outcomes.
Review B Examines AI-supported writing but combines secondary-school students, university students, and adult language learners without providing a synthesis that isolates undergraduate evidence.
Review C Closely matches the proposed population, intervention, and outcomes. Its search is comprehensive, its methods are appropriate, and its search extends through the recent evidence base.
Interpretation Reviews A and B overlap with the topic but do not independently answer the proposed question. Review C is much more consequential because it closely matches both the question and the relevant evidence.
Next action Before proceeding, the researcher should investigate whether Review C leaves a meaningful unresolved problem, such as consequential new evidence, a substantive methodological limitation, or a deliberately justified replication purpose.

The researcher should not claim a gap simply because Reviews A and B differ from the proposed review. Once Review C is identified, the burden shifts to explaining what another synthesis would add.

05 · What Researchers Often Get Wrong

Why Researchers Misjudge Whether a Question Has Been Answered

Misconception

“The Title Is Almost the Same as Mine”

Titles are imperfect summaries of review scope. Read the research question, eligibility criteria, included studies, outcomes, and synthesis before judging equivalence.

Misconception

“The Review Includes My Topic, So It Answers My Question”

A broad review may contain studies relevant to your question without synthesizing them in a way that answers it. Inclusion somewhere within a larger evidence base is different from direct analysis of your question.

Misconception

“The Review Is Recent, So the Evidence Must Be Current”

Check the final search date. Publication can occur well after searching ends, and search adequacy depends on more than timing.

Misconception

“The Authors Reached a Conclusion, So the Question Is Settled”

A conclusion can coexist with sparse, heterogeneous, biased, or imprecise evidence. Examine the evidence supporting the interpretation rather than treating the conclusion as proof of certainty.

Misconception

“Any Difference Between My Review and Theirs Creates a Gap”

A narrower date range, different database, new geographic restriction, or slightly altered terminology creates a difference, but not necessarily a useful research gap. The difference should matter to the answer.

06 · What This Means for You

Make an Answered-Question Assessment Before Starting the Review

For each existing review that appears close to your proposed question, document the comparison rather than relying on an impression of similarity.

A simple decision framework

If the question differs substantially
Explain the substantive difference and why it matters rather than simply claiming that no identical review exists.
If the question matches but relevant evidence is missing
Determine why it is missing and whether incorporating it could materially improve the answer.
If the question and evidence match but the review has consequential methodological problems
Identify specifically how those problems could affect the reliability of the synthesis.
If several similar reviews reach different conclusions
Investigate the source of disagreement before deciding whether another synthesis could usefully resolve the conflict.
If a rigorous, current review closely matches the question and evidence
Treat substantial duplication cautiously and require a clear scientific rationale before proceeding.

What you are looking for is not an excuse to conduct your preferred review. You are testing whether an unresolved problem actually remains.

07 · A Quick Checklist

Check Whether an Existing Review Already Answers Your Question

For each closely related review, check:
Compare its explicit review question with the question you intend to answer.
Compare populations, interventions or phenomena, comparators, outcomes, contexts, and eligible study designs where relevant.
Read the eligibility criteria rather than relying on the title or abstract.
Check the information sources, search strategy, restrictions, and final search date.
Inspect which primary studies actually contributed to the relevant synthesis.
Appraise methodological quality or risk of bias using an appropriate framework when warranted.
Examine the results and limitations rather than relying solely on the authors' conclusion.
Search for consequential evidence published after the review's final search.
Write down precisely what uncertainty remains after considering the strongest existing review.
08 · Frequently Asked Questions

Questions About Existing Reviews and Research Gaps

Do I need to read every existing review in full?

You should examine in sufficient detail every review that could plausibly answer substantially the same question. Titles and abstracts can help with initial screening, but the closest reviews usually require full-text examination of their scope, methods, evidence, and findings.

What if an existing review answers only part of my question?

Identify exactly which part remains unresolved and whether that difference is substantial enough to warrant another synthesis. Partial overlap is common and does not automatically imply either redundancy or novelty.

Does a different population automatically make my question new?

No. Explain why the population difference could plausibly alter the evidence, interpretation, or applicability. Merely substituting one population label for another is not necessarily a meaningful gap.

Should I compare the primary studies included in existing reviews?

Often, yes. Comparing included studies can reveal whether apparently different reviews rely on essentially the same evidence, whether relevant studies were omitted, and how much the evidence bases actually overlap.

What if existing reviews disagree?

Investigate why. Differences in eligibility criteria, searches, included studies, appraisal methods, synthesis, or interpretation may explain apparently conflicting conclusions. The disagreement itself is a signal for investigation, not automatic proof that another review is required.

Can a question be reviewed but still not be answered?

Yes. A review may find insufficient, inconsistent, indirect, or methodologically weak evidence. In that case, the synthesis may correctly establish that substantial uncertainty remains.

09 · The Bottom Line

Judge the Evidence the Review Actually Synthesized

The Bottom Line

Existing reviews answer your question only when they sufficiently match the question you need answered and provide a current, methodologically credible, and applicable synthesis of the relevant evidence.

Do not equate a similar title with redundancy, but do not manufacture novelty from minor differences either. Compare questions, eligibility criteria, searches, evidence, methods, and findings. What remains after that comparison is the gap you may actually have to justify.

10 · Sources and Further Reading

Authoritative Guidance on Comparing Existing Reviews

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes