01 · The Question
If a DOI Leads to a Real Paper, Does That Make the Citation Correct?
You ask generative AI to support a statement in your manuscript. It supplies a journal article with a DOI. You click the identifier, the publisher's website opens, and the article exists exactly where the AI said it would.
At first glance, the citation appears verified. But what if the paper investigates a different outcome? What if its findings are inconclusive, or the authors actually reached the opposite conclusion?
A DOI can help you establish which publication has been cited. It cannot tell you whether the publication provides appropriate evidence for the statement attached to it. Confusing these two forms of verification can allow unsupported claims to enter a manuscript even when every reference points to a real scholarly work.
03 · What You Need to Know
What a DOI Can Verify and What It Cannot
What Does a DOI Actually Establish?
A Digital Object Identifier (DOI) is a persistent identifier assigned to an object. In scholarly communication, DOIs commonly identify journal articles, books, book chapters, datasets, preprints, and other research outputs.
The DOI system is administered through a registration infrastructure that supports persistent identification and resolution. A DOI generally begins with 10., followed by a registrant prefix, a slash, and a suffix.
For example, the DOI 10.1038/s41598-023-41032-5 identifies the article Fabrication and Errors in the Bibliographic Citations Generated by ChatGPT, published in Scientific Reports.
When you open a DOI link, the resolution service directs you to the location associated with that identifier. The destination commonly provides bibliographic details or access information for the registered object.
Crossref explains that its members register metadata, including information such as titles, authors, publication dates, and online locations. Importantly, Crossref does not require the full content of the publication to be deposited as part of the registration process.
Consequently, DOI registration should not be interpreted as an independent assessment of the scientific validity of the publication.
There Are Three Different Questions Hidden Inside Citation Verification
Researchers often treat citation verification as one activity, although it involves several distinct judgments.
Identifier verification
Does the DOI resolve to a registered object, and what object does it identify?
Bibliographic verification
Do the title, authors, publication year, journal, and other citation details correspond to the identified publication?
Evidentiary verification
Does the publication's actual content provide appropriate support for the specific statement in the manuscript?
Passing the first two checks does not guarantee the third.
A reference may be perfectly accurate as a bibliographic record while being entirely inappropriate as evidence for the associated claim. This is particularly concerning when AI generates references and summaries together, creating the impression that the citation has already been matched to the statement.
How Can a Real Paper Be Used to Support a False or Exaggerated Claim?
Several forms of citation misuse can occur even when the cited publication is genuine.
| Problem |
What the Paper Actually Shows |
What the Citation Incorrectly Claims |
| Outcome substitution |
Students report greater satisfaction with AI feedback. |
AI feedback improves students' academic achievement. |
| Causal overstatement |
AI use is associated with higher performance. |
AI use causes higher performance. |
| Population overgeneralization |
An intervention is studied among university students. |
The intervention is effective for learners of all ages. |
| Selective interpretation |
Findings are mixed or statistically uncertain. |
The study conclusively demonstrates effectiveness. |
| Conceptual misattribution |
The article discusses a theoretical framework without testing it. |
The article empirically validates the framework. |
| Contradictory attribution |
The authors report no clear improvement. |
The authors found substantial improvement. |
These examples are hypothetical. They illustrate ways that a genuine publication can be cited inaccurately without any problem in its DOI or bibliographic record.
In each case, the reference may pass a DOI check while failing the more important question of whether the evidence supports the manuscript's assertion.
Why Is This Particularly Risky With AI-Generated References?
Generative AI can produce a plausible relationship between a scholarly publication and a claim without adequately establishing that the relationship exists.
For example, a model might identify a real article about AI-supported learning and summarize it as demonstrating improved academic performance. The article may instead examine students' attitudes toward AI, teachers' adoption intentions, or implementation challenges.
The resulting citation is not fabricated in the conventional sense. Its title, authors, journal, and DOI may all be correct. The error lies in the interpretation of what the paper establishes.
This form of misattributing research findings to genuine publications can be harder to detect than a nonexistent citation because an initial bibliographic search appears to confirm the source.
Researchers should therefore avoid interpreting successful DOI resolution as evidence that an AI-generated summary was based on a complete and accurate reading of the article.
How Do You Verify Whether a Publication Supports a Specific Claim?
Start with the exact sentence in your manuscript. Identify what the statement asserts and what evidence would be necessary to justify it.
Then examine the cited publication for the relevant information.
Identify the claim.
Determine whether your statement concerns prevalence, association, causation, effectiveness, theoretical explanation, or another type of assertion.
Locate the relevant evidence.
Examine the paper's research objectives, methods, results, tables, and relevant discussion. Avoid relying exclusively on the abstract or AI-generated summary.
Compare the scope of the evidence.
Check whether the population, intervention, measures, setting, and research design correspond to what your statement implies.
Evaluate the strength of the inference.
Determine whether the results justify the wording of your claim, including any causal language, magnitude, certainty, or generalization.
Revise the claim or replace the source.
If the paper provides narrower evidence, qualify the statement. If it does not support the claim, locate more appropriate research.
This process may take longer than checking a DOI, but it addresses the actual purpose of scholarly citation: allowing readers to examine the evidence underlying a statement.
What If the Paper Supports Only Part of the Claim?
Partial support does not necessarily make a reference unusable. It may mean that the manuscript statement needs more careful wording.
Suppose a study reports that students who used AI-assisted feedback expressed greater confidence in their writing. A manuscript statement claiming that AI improves writing quality would go beyond that evidence.
A more defensible statement might be that students reported increased confidence following the use of AI-assisted feedback, provided the study's design and results support that interpretation.
Similarly, if a study identifies an association, describe it as an association unless the design and analysis justify stronger causal language.
Good citation practice does not require every study to establish a definitive conclusion. It requires researchers to represent the available evidence accurately, including its limitations and uncertainty.
Can a Real DOI Belong to a Different Publication?
Yes. An AI-generated citation may contain a genuine DOI that identifies a publication other than the one described.
For example, a model may provide the correct title of one paper but attach a DOI belonging to another. Alternatively, it may combine a real DOI with incorrect authors or publication details.
This means DOI verification should include comparing the destination record with the complete reference. A successful redirect alone is insufficient.
The broader problem of incorrect bibliographic metadata in AI-generated citations illustrates why researchers should check the complete identity of the cited work rather than isolated identifiers.
Does a DOI Indicate That a Paper Is Peer-Reviewed or Methodologically Sound?
No. DOI registration is not equivalent to peer review, methodological assessment, or endorsement of research quality.
DOIs can identify different types of scholarly objects, including preprints and datasets. These outputs may have undergone different forms of review, or no conventional journal peer review at all.
Even when a DOI identifies a peer-reviewed journal article, the presence of peer review does not guarantee that the findings are correct or that the study provides strong evidence for a particular claim.
Crossref's documentation describes DOI registration as a mechanism for identifying and connecting research objects through metadata. It is not a certification process for the validity of their scientific conclusions.
04 · A Practical Example
A Genuine DOI Attached to an Unsupported Research Claim
Hypothetical Example
AI Feedback and Undergraduate Writing Performance
Suppose a researcher is writing a manuscript about generative AI in higher education. The manuscript contains the following statement:
"Previous research demonstrates that generative AI feedback significantly improves undergraduate students' academic writing performance."
An AI assistant supplies a genuine journal article with a working DOI. The title concerns students' experiences with AI-generated writing feedback.
However, the original study used a questionnaire to investigate perceived usefulness and satisfaction. It did not assess writing performance or compare achievement outcomes.
DOI verification: Passed.
The identifier resolves to the correct publication.
Bibliographic verification: Passed.
The article title, authors, journal, and publication details match the publisher's record.
Claim verification: Failed.
The paper provides evidence about students' perceptions, not demonstrated improvements in writing performance.
Appropriate action: Revise or replace.
The researcher may revise the statement to describe perceived usefulness or find a study that directly measures writing achievement.
The reference is real, but the claim is not supported by that reference. Nothing about the DOI itself could reveal this mismatch without examining the paper's contents.
This is precisely why bibliographic authenticity and evidentiary accuracy should be evaluated separately.
06 · What This Means for You
Use DOI Verification as the Beginning of Source Evaluation
A DOI is valuable because it can make a publication easier to identify, retrieve, and distinguish from similarly titled works. Researchers should use that capability, but avoid assigning it evidentiary significance that it does not possess.
When evaluating an AI-generated citation, ask two separate questions: Is this the correct publication? Does this publication actually support what I am saying?
A simple decision framework
If the DOI does not resolve
Check for transcription errors and search the publication independently. Do not assume that the citation is necessarily fabricated.
If the DOI resolves to a different publication
Investigate the mismatch and correct the identifier only after establishing the intended source.
If the DOI and bibliographic details match
Proceed to examine the publication's content. Bibliographic verification is complete, but claim verification remains necessary.
If the paper supports a narrower conclusion
Qualify the manuscript statement to reflect the evidence actually reported.
If the paper contradicts or does not address the claim
Do not use it as supporting evidence. Revise the argument or locate an appropriate source.
For claims central to your manuscript, it may be useful to record the specific result, table, page, or passage that supports the statement. This makes it easier to revisit the evidence during revision and reduces reliance on AI-generated summaries.
The broader practice of evaluating AI-suggested papers before manuscript inclusion should incorporate both bibliographic checks and critical assessment of the underlying evidence.
07 · A Quick Checklist
What to Check After Finding a Real DOI
Before treating a DOI-linked paper as supporting evidence, check:
Resolve the DOI through doi.org and identify the registered publication.
Compare the destination title, authors, journal, and publication year with the citation.
Identify whether the object is a journal article, preprint, dataset, or another research output.
Read the relevant methods, results, and conclusions of the original publication.
Compare the study's population, outcomes, and research design with the manuscript claim.
Determine whether the evidence supports causal, correlational, descriptive, or other wording used in the statement.
Check for corrections or retractions that may affect the interpretation.
Revise or remove the citation if the publication does not support the claim.