Can Generative AI Invent Quotations From Research Papers?

Can AI Put Quotation Marks Around Words the Researcher Never Wrote?

You ask a generative AI system what an author said about a particular issue. It responds with a polished quotation, perhaps accompanied by the author's name, publication year, and page number.

Quotation marks create a strong impression of precision. Unlike a summary, a direct quotation appears to promise that these are the source's actual words.

That promise may be false.

Generative AI can fabricate quotations, alter genuine passages, merge wording from different parts of a source, or attribute real wording to the wrong author or paper. A quotation can therefore look extraordinarily precise while being unsupported by the source it supposedly reproduces.

Can Generative AI Fabricate Direct Quotations?

How Can AI Get a Research Quotation Wrong?

A Direct Quotation Makes a Stronger Claim Than a Paraphrase

A paraphrase says, in effect, “this is what I understand the source to mean.” A direct quotation makes a narrower and more verifiable claim: “these are the words the source actually uses.”

That distinction makes quotation hallucinations particularly problematic.

If generative AI creates a polished sentence that accurately summarizes an author's position but places quotation marks around it, the problem does not disappear merely because the meaning is broadly correct. It is still not a valid direct quotation.

AI Can Generate What an Author Might Plausibly Have Said

Language models are good at generating contextually appropriate language. If you ask what a researcher said about a theory, the system may produce wording that fits the author's known position, the paper's topic, and the conventions of academic prose.

That capability creates an obvious risk when the output is requested as a quotation.

The generated sentence may be an excellent summary of the paper while having no verbatim counterpart anywhere in it. The quotation can therefore be semantically plausible and textually fictional at the same time.

This follows from the same underlying distinction that makes AI hallucinations sound convincing: linguistic plausibility does not establish source fidelity.

A Quotation Can Be Partly Real and Partly Generated

Fabrication is not always all-or-nothing. A generated quotation may closely resemble a genuine passage while changing a few words, deleting qualifications, or inserting language that makes the claim stronger.

Consider a source stating that a particular approach “may contribute to improved engagement under some conditions.” A generated quotation might reproduce the surrounding idea while turning the statement into a categorical claim that the approach “improves student engagement.”

The difference may look small. Evidentially, it is substantial.

AI Can Turn a Paraphrase Into a Fake Quotation

One especially easy error to miss occurs when an AI first summarizes a source correctly and later reproduces its own summary as though it were source text.

Suppose you ask, “What is the author's main argument?” The model generates an accurate paraphrase. You then ask, “Can you give me the exact quote for that?” Instead of locating a passage, the system may transform the paraphrased idea into quotation-like wording.

The resulting sentence can remain faithful to the general argument while being completely unsuitable as a direct quotation.

A Page Number Can Also Be Hallucinated

A quotation accompanied by a page number feels particularly authoritative because the locator appears to make verification easy.

But page numbers can also be generated incorrectly.

The quoted wording may not appear on that page, may appear elsewhere, or may not occur anywhere in the document. Pagination can also differ among accepted manuscripts, publisher PDFs, HTML versions, and other editions, so even a genuinely sourced quotation requires the locator appropriate to the version being cited.

Do not infer that a quotation has been checked merely because the AI supplies “p. 17.” Open page 17.

A Real Paper Does Not Make an Invented Quotation Real

This is a particularly deceptive scenario. The paper genuinely exists. The author genuinely discusses the topic. The AI supplies a quotation that accurately captures the general position.

Everything seems to align except the words themselves.

Finding the paper therefore verifies only the source's existence. It does not verify the quotation. This is one reason researchers need to distinguish bibliographic verification from the broader problem of AI misrepresenting a real research paper.

A Genuine Quotation Can Still Be Misleading Out of Context

Not every quotation problem involves fabricated wording. AI can extract real words while omitting the context needed to understand them.

A paper might state a proposition while summarizing another researcher's argument, describing a hypothesis that was subsequently rejected, or explaining a limitation. Extracting that sentence alone can make it appear to express the paper's own conclusion.

Similarly, a qualification immediately before or after the quoted sentence may substantially alter its meaning.

Researchers need both.

Quotation Verification Is Usually Easier Than Guessing Whether AI Hallucinated

Trying to infer whether a quotation “sounds like” something an author would say is unnecessary when you have access to the source.

Search for a distinctive phrase from the generated quotation in the original PDF or HTML article. If you find it, compare the complete passage. If you do not, try shorter distinctive fragments in case punctuation or formatting differs.

If the wording still cannot be located, do not use it as a direct quotation.

If You Cannot Verify the Exact Words, Paraphrase From the Source Instead

Sometimes an AI-generated quotation captures a useful idea but cannot be located verbatim. The solution is not to remove the quotation marks and keep the sentence unchanged.

Return to the original source, determine what it actually argues, and write your own faithful paraphrase. Cite the source according to the relevant style and disciplinary conventions.

The source should govern the paraphrase, not the hallucinated quotation.

When the Quotation Captures the Idea but Never Appears in the Paper

The generated sentence may have been an excellent summary. That does not make it something the authors wrote.

Common Mistakes When Using AI-Generated Quotations

Treat AI-Generated Quotations as Unverified Until You Find the Words

Direct quotation is one area where the verification rule can be unusually simple: if you intend to present words as the author's words, locate those words in the source.

AI can help you locate passages worth examining. It should not be allowed to decide, without verification, which exact words another scholar supposedly wrote.

Before Using a Quotation Supplied by Generative AI

Frequently Asked Questions About AI-Invented Quotations

Quotation Marks Require Verbatim Verification

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.