Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

What Should You Do When a Review Includes a Study That Was Later Retracted?

A study can be retracted after it has already entered a systematic review or meta-analysis. The key question is whether removing that study changes the synthesis, its conclusions, or the decisions based on it.

438
When a Review Includes a Retracted Study Guide 438 of 899
01 · The Question

What Happens to a Review When One of Its Included Studies Is Retracted?

A systematic review or meta-analysis may have been conducted correctly using the publication record available at the time. Months or years later, however, one of its included studies can be retracted.

That creates a second-order problem. The retraction affects the primary study, but the study's data, effect estimate, or conclusions may already have been incorporated into a review that other researchers now treat as higher-level evidence.

Does the entire review become unreliable? Should the retracted study simply be deleted? Or does the synthesis need to be recalculated?

The answer depends on what the retracted study contributed and how much the review's findings depend on it.

02 · The Short Answer

Reassess the Review Without the Retracted Evidence

In Brief

If a review includes a study that was later retracted, determine why it was retracted, identify exactly where its data or conclusions entered the review, and reassess the synthesis without evidence that can no longer be relied upon.

The review does not automatically become worthless, but its conclusions cannot simply be assumed to remain unchanged. In a quantitative synthesis, this may require reanalysis without the affected study; in a narrative synthesis, it may require reconsidering claims whose support depended on it.

03 · What You Need to Know

A Retraction Can Propagate Into Secondary Evidence

The Review May Have Been Correct When It Was Conducted

A later retraction does not necessarily mean that the review authors originally made an error. The primary study may have had no retraction notice when the review's searches and analyses were completed.

This distinction matters when interpreting an older review. Systematic reviews represent an evidence base assembled at a particular time. The underlying literature can subsequently change through new studies, corrections, expressions of concern, and retractions.

Cochrane therefore advises review authors to examine relevant retraction notices and errata both when studies are first considered and when reviews are updated. Its current guidance specifically notes that previously included studies may later have been corrected or retracted.

First Determine What Was Actually Retracted

A study and a publication are related but not always identical units. One study can generate several journal articles, conference reports, follow-up papers, or secondary analyses. A retraction may apply to one publication associated with a study rather than automatically to every report arising from the same research project.

Start by reading the formal retraction notice. Determine which publication was retracted, why, and what findings or data are affected. COPE recommends that retraction notices identify the affected article and state the reason for retraction.

If the retraction makes the study data used in the review unreliable, those data require direct attention. If the situation is more complicated, avoid assuming either that everything associated with the study is invalid or that unaffected-looking data remain trustworthy without further examination.

Trace the Retracted Study Through the Review

Once you know what has been affected, identify where the study contributed to the review.

Possible contribution What to check Potential consequence
Meta-analysis Which effect estimates came from the retracted study Pooled estimates, confidence intervals, heterogeneity, or conclusions may change
Narrative synthesis Which claims rely on the retracted findings Strength or direction of the narrative conclusion may change
Subgroup analysis Whether the study dominates a small subgroup A subgroup finding may weaken or disappear
Rare adverse outcome Whether the study supplies unusual or unique events Risk interpretation may change substantially
Methodological discussion Whether the review relies on unaffected or affected material Impact depends on the scope and reason for retraction
Certainty assessment Whether removing the study changes the body of evidence Confidence in the review's conclusion may need reassessment

Do Not Assume a Small Study Has a Small Effect

The number of participants in the retracted study does not by itself tell you how much its removal will matter. Its influence depends on the synthesis.

A relatively small study could be the only evidence for a particular subgroup, outcome, intervention, or population. An unusually large effect could also influence a pooled estimate or the interpretation of heterogeneity. Conversely, a large retracted study might have little effect on a particular conclusion if numerous independent studies provide consistent evidence.

The relevant question is therefore counterfactual: what does the review show when the affected evidence is no longer allowed to support the conclusion?

For Meta-Analyses, Recalculate When Possible

If the retracted study contributed numerical data to a meta-analysis and you have access to the necessary information, removing its contribution and recalculating the synthesis can show whether the pooled result changes materially.

You might examine changes in the pooled effect estimate, uncertainty, heterogeneity, subgroup findings, and the substantive interpretation of the result. A threshold such as statistical significance should not be the only criterion. A pooled estimate can remain on the same side of a significance threshold while changing enough to matter scientifically or practically.

Cochrane's guidance for updating reviews states that where data appear incorrect or possibly fabricated, they should be removed from the review analysis and that this decision should be reported. In 2026, Cochrane also introduced a framework specifically for determining the impact of studies with associated retractions on published reviews.

Watch Out

Do not call a recalculation a sensitivity analysis if the retracted evidence is no longer eligible to support the primary synthesis under the review's applicable rules. A sensitivity analysis can help show how influential the study was, but it does not necessarily justify retaining unreliable evidence in the main estimate.

Narrative Reviews Need Reassessment Too

Retractions are not only a meta-analysis problem. In a narrative review, an influential retracted study may support a central statement, establish an apparent pattern, supply the only evidence for a particular proposition, or shape the authors' interpretation of conflicting results.

Remove the retracted study mentally from the evidential chain and ask whether the same conclusion still follows from the remaining studies.

This can be surprisingly revealing. A paragraph containing six citations may appear well supported until you discover that several of those papers merely repeat a claim originating in the same retracted study. Tracing continued citations of retracted evidence can therefore be necessary even when the retracted article appears only once in the review's reference list.

The Review Itself May Need Correction or Updating

If you are an author of the affected review, discovering the retraction should prompt an assessment of whether the published review needs an update, correction, editorial notice, or another response under the publisher's policies.

Cochrane's 2026 framework explicitly addresses published reviews containing studies associated with retracted articles. Cochrane notes that publishers should inform readers when included studies are retracted and assess the effect on the review's findings and conclusions. Where confidence in the review's conclusions is undermined, stronger editorial action may be necessary.

The appropriate response depends on impact. A retracted study whose removal leaves every important conclusion essentially unchanged presents a different situation from one whose removal reverses the principal finding.

If You Are Only a Reader, Check for an Updated Version

You may encounter the problem while reading someone else's systematic review. Before attempting to reconstruct the analysis yourself, check whether the review has already been updated, corrected, accompanied by an editorial note, or superseded by a newer synthesis.

If no update exists and the review matters to your work, inspect the contribution of the retracted study as far as the available reporting allows. If you cannot determine its influence, that uncertainty should temper how confidently you rely on the review.

Retraction Does Not Automatically Invalidate Every Other Included Study

The presence of one retracted study does not logically contaminate all independent evidence in the review. Other included studies should be evaluated on their own merits.

However, if the retraction involves fabrication or another integrity problem, additional publications from the same research group may warrant scrutiny when there are concrete reasons to suspect related problems. Cochrane guidance advises checking other eligible studies by the same authors for similar issues when data appear incorrect or possibly fabricated.

That is a reason for targeted verification, not guilt by association.

04 · A Practical Example

What Happens When a Retracted Study Influenced a Meta-Analysis?

Hypothetical Example

A Five-Study Meta-Analysis Loses One Included Study

Imagine that a published review combines five independent studies evaluating an intervention. One study reports a much larger benefit than the others. Two years later, that study is retracted because the data supporting its main result are found to be unreliable.

Verify the retraction You read the journal's notice and confirm that the outcome data used in the meta-analysis are affected.
Locate the contribution The retracted study contributed directly to the pooled primary outcome and also appeared in a subgroup analysis.
Recalculate without it The pooled effect becomes substantially smaller and its uncertainty increases.
Revisit interpretation The remaining studies still suggest a possible benefit, but no longer support the strong conclusion stated in the original review.
Update the scholarly record If you are the review author, you report the retraction and revised analysis through the appropriate update or editorial process. If you are a reader, you do not continue quoting the original pooled estimate without qualification.

The review did not become automatically useless. What changed was the evidence available to support its original conclusion.

05 · What Researchers Often Get Wrong

Common Mistakes When an Included Study Is Retracted

Misconception

The Entire Review Is Automatically Invalid

Not necessarily. The effect depends on how much the retracted study contributed to the review's findings and conclusions. Reassess the synthesis rather than judging the review solely from the presence of one retraction.

Misconception

Deleting the Study From the Reference List Solves the Problem

No. Its data or conclusions may already be embedded in pooled estimates, tables, certainty assessments, narrative conclusions, or recommendations. The synthesis itself must be reassessed.

Misconception

If the Pooled Result Remains Statistically Significant, Nothing Important Changed

Statistical significance alone is an inadequate test of impact. Examine changes in effect magnitude, uncertainty, heterogeneity, clinical or practical interpretation, and the strength of the resulting conclusion.

Misconception

The Review Authors Should Have Known the Study Would Be Retracted

Not if the retraction occurred after the review was completed. Evaluate whether the study's status was discoverable at the relevant time and whether the review has subsequently been updated rather than assuming retrospective knowledge.

Misconception

Only Meta-Analyses Are Affected by Retractions

Narrative syntheses can also depend heavily on retracted findings. Any conclusion that relies materially on the affected evidence may need reconsideration.

06 · What This Means for You

Ask What the Review Looks Like Without the Retracted Study

The most useful response is an impact assessment rather than a binary judgment about the whole review.

A simple decision framework

If the retracted study contributed quantitative data
Recalculate or locate an updated analysis without the affected data where possible.
If it supported a narrative conclusion
Reassess whether the remaining independent evidence still supports that conclusion.
If removing it barely changes the findings
The review may remain informative, but the retraction and reassessment should still be acknowledged where relevant.
If removing it materially changes the findings
Do not continue relying on the review's original conclusion without accounting for the changed evidence base.
If you cannot determine its influence
Treat the review's affected conclusions with additional uncertainty and look for an updated or independent synthesis.
07 · A Quick Checklist

When You Discover a Retracted Study Inside a Review

Before relying on the review, check:
Verify the retraction through the publisher, formal notice, or authoritative bibliographic record.
Read why the publication was retracted and determine which data or findings are affected.
Identify every analysis, table, outcome, subgroup, or narrative conclusion to which the study contributed.
Check whether the review has already been updated, corrected, or accompanied by an editorial notice.
For quantitative synthesis, examine the result without the affected study where possible.
For narrative synthesis, determine whether the remaining independent studies still support the same conclusion.
Reconsider certainty or confidence in the evidence if removal changes the body of evidence materially.
Document any exclusion, reanalysis, or change in interpretation transparently if you are updating the review.
08 · Frequently Asked Questions

Questions About Reviews Containing Retracted Studies

Does one retracted study invalidate an entire systematic review?

No. Its impact depends on what it contributed and whether the review's findings remain supported after the affected evidence is removed. The review requires reassessment rather than automatic dismissal.

Should a retracted study always be removed from a meta-analysis?

When the data used in the synthesis can no longer be relied upon, they should not continue contributing to the primary estimate. Cochrane's current policy excludes studies associated with retracted publications from its reviews, while the exact procedure for other reviews should follow their applicable protocol and editorial standards.

What if the retraction occurred after the review was published?

The review may have accurately represented the evidence available when it was completed. Once the retraction is known, however, its impact on the review should be assessed and the published record updated when necessary.

Should I perform a sensitivity analysis without the retracted study?

Reanalysis without the affected study can be useful for determining how much it influenced the original synthesis. If the study's data are no longer considered eligible or reliable, however, the analysis excluding them may become the relevant primary analysis rather than merely an optional sensitivity check.

What if the review is narrative rather than quantitative?

Trace which statements and conclusions rely on the retracted study, then determine whether those claims remain supported by independent evidence. Numerical recalculation is not required for a retraction to matter.

What if only one publication from a study was retracted?

Read the retraction notice and determine what it says about the affected publication, study, and data. Do not automatically extend the retraction beyond its documented scope, but do not assume related reports are unaffected when they depend on the same compromised material.

Could the systematic review itself need to be retracted?

Potentially, if the loss of the retracted evidence seriously undermines confidence in the review's own findings and an update or correction cannot adequately address the problem. Cochrane's current framework explicitly recognizes that the appropriate editorial response depends on the impact on the review's findings and conclusions.

09 · The Bottom Line

Remove the Retracted Evidence, Then See What Remains

The Bottom Line

When a review includes a study that was later retracted, assess the review again without evidence that can no longer be relied upon and determine whether its results, certainty, or conclusions materially change.

The presence of a retracted study does not automatically destroy the entire review, nor can it be fixed by deleting a reference. Trace its contribution through the synthesis, use an updated analysis when available, and base your interpretation on the evidence that remains defensible.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes