01 · The Question
How Much Can You Change Before It Is No Longer an Update?
You begin with a straightforward plan: update an existing systematic review. Then the revisions accumulate.
The search needs redesigning. A new intervention belongs in scope. The population definition needs changing. Important outcomes have emerged. Several eligibility criteria no longer make sense. The risk-of-bias framework and synthesis methods need revision. Eventually, the awkward question appears: are you still updating the original review, or are you now conducting a different review that happens to have an earlier review as its starting point?
There is no universal numerical threshold for that boundary. Updating guidance explicitly allows changes to review questions, criteria, searches, methods, and analyses when justified. The distinction becomes more important when those changes alter the identity of the question or break the methodological continuity that makes the new work meaningfully interpretable as a continuation of the previous review.
03 · What You Need to Know
The Boundary Depends More on Continuity Than on the Number of Changes
An update is allowed to change
An update is not required to reproduce the previous review mechanically. Consensus guidance recommends reassessing the original review's question, methods, and evidence and allows modifications when they are justified. Search strategies may be refined, new evidence incorporated, methods updated, and analyses revised.
If any methodological change automatically created a new review, rigorous updating would be nearly impossible. Reviews would be forced to preserve outdated methods merely to retain the word "update."
The review question provides the strongest anchor
Start by comparing the old and proposed questions. Are they trying to resolve the same underlying uncertainty for substantially the same population, intervention or exposure, comparator, outcomes, and context?
Not every modification changes the identity of the question. Clarifying a population definition may improve precision. Adding a newly important outcome may extend the existing review. Updating terminology may simply reflect changes in the field.
But replacing the population, introducing fundamentally different interventions, changing the phenomenon of interest, or shifting to a substantially different decision problem can move the work beyond updating.
Updating the same question
Reassessing substantially the same underlying uncertainty using newer evidence and, where justified, improved methods.
Asking a new question
Changing the conceptual target enough that the resulting synthesis addresses a materially different uncertainty.
Scope expansion is not automatically a new review
A review can legitimately expand in response to developments in the field. Current updating guidance recommends reconsidering whether the scope and question remain appropriate and whether newly relevant comparisons, outcomes, or methods should be incorporated.
The issue is degree. Adding a closely related intervention may preserve the original conceptual purpose. Expanding from one intervention to an entire class of unrelated interventions may not. Adding one important outcome differs from redesigning the review around a fundamentally different set of outcomes.
Eligibility changes can reveal whether continuity still exists
Compare the original and proposed eligibility criteria side by side. Ask how many dimensions have changed and whether the same studies could, in principle, populate both reviews.
Change
Often compatible with an update
May point toward a new review
Population
Clarifying or modestly extending an existing population
Replacing it with a substantively different population
Intervention or exposure
Adding a closely related contemporary variant
Expanding to conceptually different interventions or exposures
Comparator
Adding a relevant comparison that serves the same question
Reframing the review around a different decision problem
Outcomes
Adding important outcomes relevant to the same question
Changing the central purpose of the review to different outcomes
Study designs
Adding designs for a justified aspect of the same question
Changing the evidential framework so extensively that the synthesis serves a different purpose
Context
Extending to comparable contemporary settings
Moving into settings where the original question has materially different meaning
These are diagnostic questions rather than formal classification rules. No single row independently determines whether the work is an update or a new review.
Search redesign alone usually does not create a new review
You may discover that the original search was weak, terminology changed, or new databases became relevant. Correcting those issues can substantially change the retrieval process while leaving the research question intact.
Accordingly, deciding to revise rather than exactly rerun the original search does not by itself transform the project into a new review.
Even a major repair to a weak original search strategy can remain part of an update if the project is still attempting to produce a more complete current answer to essentially the same question.
New appraisal methods usually represent methodological updating
Risk-of-bias tools, certainty frameworks, synthesis methods, and reporting standards change. Applying a current method to old and new evidence may be precisely what a rigorous update requires.
Methodological modernization therefore does not automatically sever continuity. The more difficult case arises when the analytical framework changes so fundamentally that the new review asks different questions of the evidence or synthesizes an essentially different evidence base.
Look at what happens to the older included studies
Older studies provide another useful diagnostic. If most remain relevant and can be incorporated into the updated synthesis, continuity is relatively easy to see.
If revised criteria exclude most of the previous evidence while introducing a largely different set of studies, ask why. That pattern may indicate that the new project has moved conceptually beyond the original review.
This does not mean an update must retain every previous study. Changes in eligibility, corrections, retractions, or revised methods can legitimately alter the included set. The issue is what the cumulative change says about the identity of the review.
A changed conclusion does not make it a new review
An update can completely reverse an earlier conclusion and still be an update. Indeed, detecting such changes is one reason updates exist.
Whether new evidence changes the previous conclusion is therefore separate from whether the research question changed. A different answer to the same question is still an answer to the same question.
Watch Out
Do not call a project a new review merely because the updated findings disagree with the earlier review. Classification should depend on what question and evidence framework the review addresses, not on whether its answer remained comfortable.
Cumulative small changes can become a large conceptual change
No individual amendment may appear decisive. You broaden the population slightly, add several intervention variants, change the eligible designs, revise the outcomes, and introduce another context. Each change can be defended separately.
Together, however, they may create a review with a substantially different purpose. This is why counting modifications is less useful than comparing the original and proposed review as complete conceptual objects.
Ask whether the previous protocol still describes the project
A practical test is to read the original protocol or methods without the amendments. Does it still provide a recognizable description of the updated review's central question and purpose?
If the answer is broadly yes, with transparent amendments needed to reflect methodological improvements and developments in the field, the work may still reasonably be framed as an update.
If the original protocol now describes a substantially different population, intervention, scope, and analytical purpose, calling the project an update may obscure rather than clarify what was done.
The distinction should improve transparency, not police terminology
The objective is not to discover a magical percentage of change at which an update transforms into a new review. The classification should help readers understand the relationship between the previous and current evidence syntheses.
Whichever description is used, report the relationship transparently. Explain what was inherited, what was reconsidered, what changed, and why. Consensus updating guidance emphasizes reviewing the currency and relevance of the question and methods rather than mechanically preserving an earlier version.
04 · A Practical Example
When Incremental Changes Eventually Produce a Different Review
Hypothetical Example
An update of digital feedback interventions begins to expand
Suppose the original review examined automated written feedback for university students and included controlled studies reporting learning outcomes. Five years later, the researchers plan an update.
First proposed change
The researchers add contemporary AI-assisted written-feedback systems. These remain conceptually close to the original intervention and could reasonably fit the existing question.
Second proposed change
They add conversational tutoring systems, automated grading, recommendation systems, and generative tools used for content creation.
Third proposed change
The population expands from university students to learners in primary, secondary, vocational, and higher education.
Fourth proposed change
The outcomes expand from learning outcomes to teacher workload, institutional adoption, student attitudes, academic integrity, and implementation.
Compare the resulting question
The proposed synthesis now asks about educational AI technologies across educational sectors and multiple types of outcomes rather than specifically about automated written feedback for university learning.
Classify the project
Although the old review may provide useful background and eligible studies for one subset, describing the expanded project as an entirely new review may communicate its actual scope more accurately.
No single change necessarily crossed the boundary. The cumulative changes transformed the conceptual object being reviewed.
06 · What This Means for You
Compare the Old and Proposed Review Before Choosing the Label
A simple decision framework
If the core question remains substantially the same and changes mainly improve currency or methods
The project can generally retain a clear identity as an update.
If eligibility criteria change but still operationalize essentially the same question
An update may remain appropriate, provided the amendments and their historical consequences are transparent.
If several dimensions of the question expand substantially
Compare the cumulative scope with the original review rather than evaluating each amendment separately.
If the previous protocol no longer describes the central purpose of the proposed synthesis
A new review may more accurately represent the project.
If the evidence changes dramatically but the question remains the same
Treat the changed findings as the purpose of the update rather than evidence that a new review is automatically required.
When the boundary remains debatable, transparency matters more than defending a label. Describe the relationship to the previous review, identify major amendments, and explain why the current scope and methods were chosen.
The broader process of updating a literature review without starting from scratch depends on precisely this distinction: reuse what remains valid, revise what no longer works, and recognize when the amount of conceptual change means you are no longer answering the same question.
07 · A Quick Checklist
Before Calling the Project an Update
Compare the proposed review with the original:
Write the original and proposed research questions side by side.
Compare populations, interventions or exposures, comparators, outcomes, study designs, and contexts.
Identify which eligibility changes merely clarify the old question and which expand or replace it.
Check how many previously included studies remain relevant to the proposed synthesis and why.
Distinguish methodological modernization from conceptual changes to the review question.
Assess the cumulative effect of all amendments rather than judging each one in isolation.
Check whether the original protocol still provides a recognizable description of the proposed review's purpose.
Document major changes and explain why the work is being presented as an update or as a new review.
11 · Cite this Guide
How to Cite This Guide
This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.
Recommended (Field Guide)
APA
MLA
Chicago
Copy Citation
