03 · What You Need to Know
Separate the citation problem from the truth of the claim
First confirm that the source really fails to support the claim
Before concluding that a widely used citation is wrong, make sure you have compared the same proposition at the appropriate level of detail.
Identify exactly what later authors claim. Then inspect the original source's research question, study design, population, measures, analyses, results, tables, figures, and relevant discussion. If supplementary material matters, check that too.
Sometimes an apparent mismatch disappears when the complete paper is examined. The relevant result may be reported in a table rather than the abstract, or the later author may be summarizing several analyses rather than quoting one sentence.
But if the evidence still does not substantiate the proposition, you have identified a genuine problem in the source-to-claim relationship.
Determine what kind of mismatch you found
“The source does not support the claim” can describe several different situations. Identifying the type of mismatch helps determine what to do next.
| What you find |
What may have happened |
What to investigate next |
| The study examined the topic but not the claimed outcome |
Outcome substitution |
Find evidence that directly measures the claimed outcome |
| The study reports association, while later papers claim causation |
Causal strengthening |
Look for designs capable of supporting the causal claim |
| The paper proposes the idea but does not test it |
Hypothesis treated as evidence |
Find later studies that actually tested the proposition |
| The finding applies only to a narrow group |
Overgeneralization |
Look for evidence in the broader population being claimed |
| The results are mixed, but later papers report a simple positive finding |
Selective summarization |
Reconstruct the complete relevant result pattern |
| The cited paper contains no relevant evidence for the proposition |
Major quotation or attribution error |
Trace where the attribution entered the citation chain |
This comparison is the same fundamental task involved in determining whether a paper actually supports the claim for which it is cited. The difference here is that the unsupported attribution has already become widespread.
Do not make the opposite inference
Suppose dozens of papers claim that X causes Y and cite Paper A. You inspect Paper A and discover that it does not provide evidence that X causes Y.
You may conclude that Paper A does not substantiate that causal claim. You cannot conclude from this alone that X does not cause Y.
What you have established
The cited source does not provide adequate support for the proposition attributed to it.
What you have not yet established
Whether the proposition itself is true, false, or supported by other evidence elsewhere in the literature.
This distinction prevents citation checking from turning into another form of overclaiming. An unsupported reference weakens that particular evidential pathway. The broader proposition still requires investigation.
Search for independent evidence rather than another repetition
Your next question should be: what evidence actually addresses the proposition?
Search using the concepts in the claim rather than merely following papers that cite the questionable source. Look for primary studies that directly investigate the relevant population, exposure or intervention, comparison, and outcome. When appropriate, consult systematic reviews that explicitly identify and appraise such studies.
This distinction is particularly important because a frequently repeated claim can have surprisingly little direct evidence. Finding another paper that repeats the same sentence does not solve the problem if that paper ultimately relies on the same unsupported citation.
Follow the citation trail backward and forward
If the discrepancy is consequential, citation tracing can help reveal how it developed.
Backward tracing asks where the supposedly original source obtained the idea. Perhaps it cited an earlier paper that actually contains the relevant evidence. In that case, what initially looked like an unsupported claim may partly be a citation-provenance problem.
Forward tracing asks how later publications represented the source. You may find that an early paper described it cautiously, while a later review strengthened the interpretation and subsequent authors inherited that wording.
This is where citation distortion can become visible across a literature.
Identify where the meaning changed, if you can
You do not always need to find the first paper that made the error. For ordinary literature reviewing, establishing the correct evidential basis is usually more important than assigning historical responsibility.
But tracing the transition can be informative when the unsupported claim is central to a field. Compare wording across successive papers. Did “may be associated with” become “contributes to”? Did “we hypothesize” become “research has demonstrated”? Did evidence from one subgroup become a statement about an entire population?
If later papers repeatedly cite an intermediary rather than checking the primary source, the stronger wording can persist. This is one mechanism by which a secondary source can strengthen the wording of an original finding.
Check whether you are dealing with indirect citation
Sometimes authors cite an original paper that they appear to know only through another source. If the intermediary misrepresented the original, later authors may reproduce both the interpretation and the original reference without independently verifying it.
This can make an unsupported attribution look surprisingly stable. The same reference appears again and again, creating the impression that many researchers independently checked the paper.
Evidence from medical publishing indicates that secondary quotation is a measurable phenomenon. A 2025 systematic review and meta-analysis of 46 studies involving approximately 32,000 quotations or references estimated a secondary-quotation rate of 5.3%, alongside an overall quotation-error rate of 16.9%. The authors emphasized substantial heterogeneity across the included studies, so these estimates should not be generalized mechanically to other disciplines.
Major unsupported citations are not merely hypothetical
The same 2025 meta-analysis estimated that 8.0% of quotations in the medical literature studies it synthesized involved major errors, meaning roughly half of the identified quotation errors were classified as major. The authors characterized major errors as cases in which the source did not support the attached claim. Again, this evidence concerns medical literature and does not establish an equivalent rate in education, social science, engineering, or other fields.
The important point is narrower. Published references cannot simply be assumed to substantiate the statements attached to them, even when those references have survived peer review and subsequent citation.
Do not assume that repetition repairs the unsupported citation
If Paper A does not support a claim, the fact that Papers B, C, D, and E all cite Paper A for that claim does not make Paper A more supportive.
Nor do Papers B through E necessarily constitute independent evidence. They may simply constitute additional instances of the same attribution.
When later papers cite one another, the structure can become even harder to recognize because the proposition acquires multiple references and increasingly distant citation pathways. Understanding how citations propagate across generations of papers can help separate scholarly diffusion from evidential accumulation.
Use later evidence when later evidence really exists
There is another possibility: the original citation is wrong, but later research independently supports the proposition.
Suppose Paper A speculated that X might improve Y. Later papers incorrectly describe Paper A as demonstrating the effect. Meanwhile, several subsequent experiments actually test X and find evidence consistent with an effect on Y.
In that situation, the historical attribution remains inaccurate, but the contemporary evidential status of the claim may be quite different. Cite the studies that actually provide the evidence rather than preserving the erroneous attribution to Paper A.
Correcting a citation should improve the evidential chain, not force you to pretend that later evidence does not exist.
Consider corrections, retractions, and later developments
When examining an influential original source, check whether it has subsequently been corrected, retracted, or substantially reinterpreted. Also look for replications, reanalyses, and later studies that challenge the original result.
The purpose of returning to the original source is to understand provenance, not to freeze the literature at the moment that source was published.
Be precise when describing the problem
Avoid jumping from a source mismatch to accusations about researchers' intentions. Citation errors can arise through misunderstanding, indirect citation, excessive compression, or transmission through earlier secondary sources. The 2025 meta-analysis explicitly notes that quotation errors can occur without ill intent and that misinterpretation is one plausible mechanism.
Unless you have evidence about intent, describe what you can demonstrate: the source does not support the attributed proposition, the later wording differs from the original evidence, or the citation chain appears to have transmitted an unsupported interpretation.
04 · A Practical Example
What to do when a familiar claim collapses under source checking
Hypothetical Example
A widely repeated claim about online learning
Imagine that many papers state, “Online learning increases student retention,” and repeatedly cite a particular early study. You plan to use the statement in your own literature review, so you retrieve the original paper.
1. Check the supposed foundational study
The hypothetical paper compares student satisfaction with online and face-to-face instruction. It does not measure retention.
2. Define the mismatch
The source is relevant to online learning but provides no direct evidence about the retention outcome attributed to it.
3. Follow the citation history
You discover that an early review cited the study in a paragraph discussing several potential benefits of online learning. Later papers began attaching the citation specifically to the retention claim.
4. Search independently for retention evidence
Rather than searching only for papers citing the original study, you search specifically for empirical research measuring retention under online and comparison conditions.
5. Evaluate what you find
In this hypothetical example, several later studies directly measure retention, but their results are mixed and highly dependent on institutional and student characteristics.
6. Rewrite the claim
You do not cite the original satisfaction study as evidence for retention. Instead, you describe the direct retention evidence with appropriate qualification and cite the studies that actually measured it.
The discovery did not prove that online learning cannot improve retention. It revealed that the familiar citation was not evidence for that proposition and forced a more accurate reconstruction of what the literature actually showed.
07 · A Quick Checklist
What to do when a widely used citation fails
Before deciding how to handle the claim, check:
Define the exact proposition that later papers attribute to the source.
Read enough of the original source to verify its design, measures, results, and relevant qualifications.
Determine whether the source provides no support, partial support, or support only for a narrower claim.
Do not infer that the underlying proposition is false merely because one citation is unsupported.
Search independently for primary studies that directly test the proposition.
Trace backward or forward through the citation chain when understanding the origin of the mismatch matters.
Check whether later research supports, qualifies, contradicts, or supersedes the supposed original evidence.
Replace unsupported citations with sources that actually provide evidence rather than sources that merely repeat the claim.
Match your final wording to the strength, scope, and uncertainty of the evidence you verified.