Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Who Is Responsible When AI Inserts a Fabricated Citation Into Research?

When AI inserts a fabricated reference into a manuscript, responsibility does not transfer to the software. Learn how accountability is distributed among authors, coauthors, editors, and publishers, and what researchers should do when fabricated citations are discovered.

191
Who Is Responsible for AI-Fabricated Citations? Guide 191 of 384
01 · The Question

If AI Invents a Citation, Who Is Accountable for the Error?

You use generative AI to help prepare a literature review. The system inserts a scholarly reference with a convincing title, author list, journal name, and DOI. You include it in your manuscript, assuming that the citation is genuine.

During peer review, a reviewer searches for the publication and discovers that it does not exist. The reviewer asks you to explain why a fabricated source appears in the manuscript.

Can you argue that the error belongs to the AI tool because you did not personally invent the reference? Does responsibility fall on the coauthor who prepared the literature review, the corresponding author who submitted the manuscript, or the journal that failed to detect it?

These questions involve more than citation accuracy. They concern scholarly accountability, research integrity, and the responsibilities associated with authorship.

02 · The Short Answer

Human Authors Remain Responsible for Fabricated AI Citations

In Brief

When an AI-generated fabricated citation appears in a research manuscript, responsibility for the submitted scholarly content remains with the human authors. An AI tool cannot assume authorship accountability or replace the authors' obligation to verify references. The allocation of responsibility among individual coauthors depends on their contributions, agreed responsibilities, and applicable institutional or publisher policies.

A fabricated citation does not automatically establish deliberate research misconduct. The circumstances matter, including whether the error was inadvertent, whether reasonable verification occurred, and how the authors responded after discovering it. Editors and publishers also have responsibilities for editorial oversight and correction of the published record, but those responsibilities do not eliminate author accountability.

03 · What You Need to Know

How Accountability Works When AI Introduces Fabricated Academic References

Why Can't Researchers Transfer Responsibility to an AI Tool?

Authorship is not merely recognition for producing text. It carries responsibility for the accuracy, integrity, and scholarly defensibility of published work.

The Committee on Publication Ethics (COPE), in its position on authorship and AI tools, explains that AI systems cannot satisfy authorship requirements because they cannot take responsibility for submitted work or manage the obligations associated with authorship.

COPE further states that authors using AI tools remain responsible for the content of their manuscripts, including material produced with AI assistance.

The International Committee of Medical Journal Editors (ICMJE) similarly emphasizes that human authors must review AI-generated material for accuracy and ensure appropriate attribution, including full citations. COPE's position and the ICMJE recommendations provide explicit guidance on these responsibilities.

Consequently, explaining that a reference was generated by AI may help establish how an error occurred, but it does not establish that the authors were relieved of their obligation to verify it.

Does the Researcher Who Used AI Bear All the Responsibility?

Not necessarily. Responsibility may operate at several levels within a research team.

The researcher who generated or inserted the reference has a direct role in verifying the information they introduced. However, other authors may also have responsibilities arising from their contributions, manuscript review, and approval of the submitted work.

The ICMJE authorship criteria include accountability for the work and the expectation that authors can identify which coauthors are responsible for particular contributions. Authors should also have confidence in the integrity of their coauthors' contributions.

These principles do not mean that every coauthor automatically bears identical personal culpability for every mistake. Individual involvement, knowledge, assigned responsibilities, and the circumstances of the error may differ.

The distinction is between collective responsibility for the scholarly work and the assessment of an individual's conduct.

Role Relevant Responsibility Important Qualification
Researcher who introduced the AI-generated citation Verify the source and correct inaccurate or fabricated information. Direct involvement does not automatically establish intentional misconduct.
Coauthors Critically review their contributions and participate in ensuring the integrity of the manuscript. Their individual responsibility depends partly on contribution, knowledge, and applicable authorship standards.
Corresponding author Coordinate submission, communication, and responses to editorial queries. Corresponding authorship does not necessarily make one person solely responsible for every substantive error.
Editors and reviewers Evaluate manuscripts within the editorial and peer-review process and address concerns that arise. Peer review cannot guarantee detection of every fabricated citation.
Publisher or journal Apply editorial policies and maintain appropriate correction procedures for the published record. Editorial oversight does not transfer the authors' responsibility for submitted content.

These responsibilities are related but not interchangeable. Editorial oversight concerns the publication process, while authorship accountability concerns the content submitted under the authors' names.

Is an AI-Fabricated Citation Automatically Research Misconduct?

No. A fabricated reference is a serious accuracy problem, but its presence does not by itself establish the intent or circumstances required for a particular finding of research misconduct.

Research misconduct definitions vary among institutions, funders, and jurisdictions. Some frameworks distinguish fabrication, falsification, and plagiarism from honest error or differences of scholarly judgment.

For example, the United States federal research misconduct framework defines misconduct in terms of fabrication, falsification, or plagiarism in proposing, performing, reviewing, or reporting research. A formal finding also requires additional elements, including the applicable evidentiary and culpability standards.

Those definitions should not be applied automatically to every citation error or every national context.

A researcher who unknowingly includes a fabricated AI reference may have failed to exercise appropriate care. That is different from knowingly inventing a source and presenting it as genuine evidence.

However, repeated disregard of known problems, deliberate concealment, or continued reliance on a fabricated citation after its discovery may raise more serious concerns.

The appropriate classification should be determined through the relevant institutional or publisher procedures rather than inferred solely from the presence of an incorrect reference.

What Is the Difference Between an Honest Error, Negligence, and Deliberate Fabrication?

These distinctions matter when evaluating responsibility.

Honest error A mistake occurs without deliberate deception, despite an attempt to handle the research appropriately.
Negligent verification A researcher fails to exercise an appropriate level of care when checking information, even if deception was not intended.
Deliberate fabrication A person knowingly presents a nonexistent or invented source as genuine scholarly evidence.

These are practical distinctions, not a universal legal classification. Institutional policies may use different terminology or thresholds.

The consequences may also depend on the importance of the citation. A fabricated reference supporting a peripheral background statement differs in potential impact from one used as the primary evidence for a study's central conclusion.

Neither situation should be ignored, but the response should be proportionate to the circumstances and the effect on the manuscript.

Does Disclosing AI Use Remove Responsibility for Fabricated References?

No. Transparency about AI assistance and responsibility for scholarly accuracy are separate obligations.

Disclosure informs editors and readers about how AI contributed to the work. It does not establish that the generated material is correct.

COPE's position calls for transparency regarding relevant AI use and emphasizes that authors remain responsible for the resulting manuscript.

The ICMJE recommends disclosure of AI-assisted technologies used in producing submitted work, including information about how the tools were used. Its guidance also requires authors to review AI-generated content carefully.

Specific requirements vary among journals and publishers. Some distinguish routine language editing from substantive content generation, while others require broader disclosure.

Researchers should follow the current policy of the intended journal and avoid assuming that an AI-use declaration excuses inaccurate references.

What If a Coauthor Inserted the Fabricated Citation Without Your Knowledge?

This situation requires both source correction and an appropriate discussion of authorship responsibilities.

If you discover that a coauthor introduced an unverified AI citation, first establish whether the reference is genuinely fabricated or merely contains incorrect metadata.

Then determine where the citation appears, which claims depend on it, and whether the problem affects other references supplied through the same workflow.

The research team should correct the manuscript and clarify how the error occurred. Depending on the circumstances, the corresponding author may need to communicate with the journal.

Individual responsibility should not be assigned solely on the basis of who operated the AI tool. The coauthors' respective roles, review procedures, and applicable institutional policies may be relevant.

At the same time, lack of direct involvement does not eliminate the general expectation that authors critically review and approve the scholarly work attributed to them.

What If a Fabricated Reference Is Discovered During Peer Review?

The appropriate response is to acknowledge the discrepancy, investigate it, and correct the manuscript.

Begin by determining whether the publication is nonexistent, incorrectly cited, or confused with another source. The procedures for verifying AI-generated academic citations can help establish the nature of the problem.

Next, examine whether the manuscript's associated claim remains supported. If the fabricated reference was the only evidence for a statement, the claim may need to be revised or removed.

It may also be appropriate to audit other references generated through the same AI-assisted process.

When responding to reviewers, explain the correction accurately. Avoid inventing an explanation, concealing the source of the error, or substituting another unverified citation merely to preserve the original claim.

The editorial outcome depends on the journal's policies, the extent of the problem, and its effect on the manuscript's scholarly reliability.

What Happens If the Fabricated Citation Is Discovered After Publication?

Once an article has been published, correcting a fabricated citation may require formal editorial action.

The appropriate response depends on whether the error is limited to bibliographic information or affects the paper's substantive conclusions.

A minor reference error may be addressed through a correction. A fabricated citation supporting a central claim may require more extensive investigation, particularly if the claim cannot be supported by other evidence.

COPE's retraction guidelines explain that retractions are intended to correct the scholarly record when publications contain serious problems that undermine their reliability. Retraction is not automatically the appropriate response to every citation error.

Authors should contact the journal promptly when a published error may affect the article's accuracy or interpretation.

The journal's editors then determine the appropriate publication-record action under their policies and the available evidence.

Can the AI Company or Tool Provider Also Have Responsibilities?

Potentially, but those responsibilities should be distinguished from authorship accountability.

AI developers and service providers may have responsibilities concerning product design, accuracy representations, documentation, data protection, and compliance with applicable law. The extent of those responsibilities depends on the service, contractual terms, jurisdiction, and circumstances.

However, such obligations do not automatically make the provider an author of a research manuscript or transfer scholarly responsibility for citations submitted by researchers.

It would therefore be inaccurate to assume either that AI providers can never bear any responsibility or that a fabricated citation automatically creates legal liability for the provider.

The specific legal questions require analysis of applicable law and facts. The scholarly question is more straightforward: researchers must verify the evidence they present in their manuscripts.

How Can Research Teams Prevent Disputes About AI-Generated Citations?

Research teams can reduce ambiguity by establishing responsibilities before manuscript preparation begins.

For example, the team may agree that whoever introduces a new citation must locate the publication and verify the associated claim. Another coauthor may then review the references central to the manuscript's main argument.

Such arrangements do not replace collective authorship responsibilities, but they make verification procedures more explicit.

Maintaining a reference manager, retaining authoritative source records, and documenting substantive AI assistance can also help the team reconstruct how a citation entered the manuscript.

A structured workflow for using AI with academic references is particularly useful when several authors contribute to the literature review or bibliography.

04 · A Practical Example

When a Reviewer Discovers an AI-Fabricated Citation

Hypothetical Example

A Fabricated Reference in a Multi-Author Educational Technology Manuscript

Suppose three researchers submit a journal article examining generative AI adoption among university faculty.

One coauthor used an AI assistant to identify supporting literature and inserted a reference that appeared to report strong evidence of improved teaching effectiveness. The corresponding author submitted the manuscript without independently checking that reference.

During peer review, a reviewer searches for the article and finds no identifiable publication matching its title, authors, or DOI.

Establish the facts.

The authors investigate the reference and confirm that they cannot establish the publication's existence through authoritative sources.

Examine the associated claim.

The fabricated reference supports a statement about teaching effectiveness. The team checks whether other genuine studies provide appropriate evidence.

Correct the manuscript.

The authors remove the unverified reference and revise the claim according to the evidence actually available.

Review the remaining bibliography.

Because the reference came from an AI-generated list, the team audits other entries produced through the same process.

Respond to the reviewer.

The corresponding author acknowledges the error, explains the corrective action, and identifies any changes made to the manuscript's claims and references.

The example does not establish that the coauthor deliberately fabricated evidence. Nor does it mean the corresponding author was the sole person responsible for the error.

It illustrates how responsibility can involve several researchers while the immediate scholarly obligation remains clear: correct the record and ensure that the manuscript's claims are supported by genuine evidence.

05 · What Researchers Often Get Wrong

Common Misconceptions About Responsibility for AI-Fabricated Citations

Misconception

AI Created the Reference, So AI Is Responsible for the Error

AI tools cannot assume scholarly authorship accountability. Human authors remain responsible for verifying material submitted under their names.

Misconception

Only the Coauthor Who Used AI Can Be Held Accountable

Direct involvement matters, but authorship also involves broader responsibilities for reviewing and approving scholarly work. Individual culpability depends on the circumstances and applicable standards.

Misconception

Every Fabricated AI Citation Automatically Constitutes Research Misconduct

A fabricated reference is a serious problem, but formal misconduct findings depend on applicable definitions, evidence, and circumstances. Honest error should not automatically be equated with deliberate deception.

Misconception

Disclosing AI Use Protects Authors From Responsibility

Disclosure promotes transparency but does not validate generated information. Authors must still verify citations and ensure that the manuscript accurately represents its sources.

Misconception

If Peer Review Missed the Fake Citation, the Journal Is Responsible Instead

Editorial oversight does not remove the authors' responsibility for submitted content. Peer review is an evaluative process, not a guarantee that every reference has been independently authenticated.

Misconception

One Fabricated Citation Always Requires Retraction

The appropriate corrective action depends on the error's seriousness and effect on the article's reliability. Some problems may be corrected, while others may require broader investigation or editorial action.

06 · What This Means for You

What Should You Do When an AI-Fabricated Citation Is Discovered?

The immediate priority is to establish the facts and protect the accuracy of the manuscript.

A defensive explanation that blames AI is unlikely to resolve the underlying scholarly problem. The reference must be investigated, and the associated claim must be evaluated.

A simple decision framework

If you discover a suspicious AI-generated reference before submission
Verify it independently and correct or remove it before the manuscript is submitted.
If a reviewer identifies a fabricated citation
Acknowledge the issue, investigate related references, and explain the substantive corrections made.
If a coauthor introduced the reference
Address the problem collaboratively, clarify responsibilities, and ensure that the manuscript is corrected.
If the fabricated citation supports a central conclusion
Reassess whether the conclusion remains justified without the invalid source.
If the error is discovered after publication
Contact the journal and cooperate with the appropriate correction or investigation process.

For future manuscripts, establish a verification procedure that assigns responsibility for checking references while retaining collective scholarly accountability.

Before submission, it is particularly important to avoid copying an unverified AI-generated reference list directly into a manuscript.

07 · A Quick Checklist

What to Do When AI Introduces a Fabricated Citation

Before responding to the error, check:
Determine whether the reference is fabricated, incorrectly formatted, or associated with a different genuine publication.
Identify every manuscript statement supported by the problematic reference.
Assess whether the affected claims remain supported by genuine evidence.
Audit other references generated through the same AI-assisted process.
Correct or remove the fabricated citation without inventing replacement evidence.
Communicate the issue to relevant coauthors and clarify the necessary corrective actions.
Follow applicable journal and institutional policies for disclosure and correction.
If the manuscript is published, contact the journal when the error may affect the scholarly record.
Document the correction and improve the team's reference-verification procedure.
08 · Frequently Asked Questions

Frequently Asked Questions About Accountability for AI Citation Errors

Who is responsible if ChatGPT invents a reference in my paper?

The human authors remain responsible for the accuracy of the submitted manuscript. AI assistance does not transfer scholarly accountability to the tool.

Is using a fabricated AI citation automatically academic misconduct?

Not automatically. The applicable definition of misconduct, the researcher's conduct, and the circumstances of the error matter. Honest mistakes and deliberate fabrication should not be treated as equivalent.

Can a journal reject a manuscript because of fabricated AI references?

Yes. Fabricated references can raise serious concerns about source verification and manuscript reliability. Editorial decisions depend on the journal's policies and the nature and extent of the problems.

Am I responsible if my coauthor inserted the fake reference?

Coauthors share responsibilities associated with authorship, but individual culpability depends on their roles, knowledge, and conduct. The research team should investigate and correct the error rather than assume that responsibility belongs exclusively to one person.

Does declaring AI use protect me if a citation is fabricated?

No. Disclosure is a transparency requirement, not a substitute for verification. Authors remain responsible for checking the accuracy of AI-assisted manuscript content.

What should I say if a reviewer finds a fabricated citation?

Acknowledge the discrepancy, explain the verification and correction undertaken, and identify any changes to the associated manuscript claims. Avoid blaming the tool as a substitute for addressing the scholarly problem.

Can a published article be retracted because of AI-generated fake citations?

Potentially, if the problems seriously undermine the article's reliability or otherwise meet the journal's retraction criteria. A fabricated citation does not automatically require retraction; the appropriate action depends on the circumstances.

Should the corresponding author verify every AI-generated reference?

The corresponding author has important coordination responsibilities, but verification can be distributed among coauthors. The team should establish a process ensuring that all cited sources are checked and that the submitted manuscript is accurate.

09 · The Bottom Line

AI May Generate the Citation, but Authors Remain Accountable

The Bottom Line

When generative AI inserts a fabricated citation into research, scholarly responsibility remains with the human authors. The tool's involvement may explain how the error occurred, but it does not remove the obligation to verify references, correct inaccuracies, and ensure that manuscript claims are supported by genuine evidence.

Accountability should be assessed fairly, distinguishing honest mistakes from deliberate misconduct and considering the responsibilities of individual contributors. Whatever the circumstances, the appropriate response is to investigate the error, correct the scholarly record, and strengthen the verification process that allowed it to occur.

10 · Sources and Further Reading

Authoritative Guidance on AI Authorship, Accountability, and Research Integrity

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes