Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Should AI Outputs Used in Research Be Archived?

AI outputs that influence research data, analysis, or conclusions should generally be preserved as part of the research record. Learn what to archive, how to protect confidential information, and why saving outputs matters even when the original AI model remains available.

610
Archiving AI Outputs in Research Guide 610 of 1196
01 · The Question

Should Researchers Save the Actual Responses Generated by AI?

You use generative AI to extract information from journal articles, classify interview excerpts, or identify patterns in research data. You save the prompt, record the model name, and retain the final spreadsheet. But you do not preserve the individual responses that the AI generated.

Months later, a collaborator questions several classifications. You repeat the original prompt, only to discover that the model now produces different answers. The original responses are no longer available, and you cannot establish precisely what the AI generated before you corrected or summarized its outputs.

This raises a research-records question: should AI-generated outputs be archived in the same way researchers preserve raw observations, analytical scripts, and intermediate datasets?

The answer depends on what the AI outputs contributed to the research, whether they can be regenerated, and what restrictions govern their retention.

02 · The Short Answer

Yes, Preserve AI Outputs That Materially Influence the Research

In Brief

Researchers should generally archive AI-generated outputs that materially influence research data, measurements, classifications, analytical decisions, or conclusions. Preserving the actual responses creates an auditable record of what the AI produced and supports verification when the original model cannot reproduce those outputs.

Not every exploratory conversation or routine writing suggestion requires the same retention treatment. Archiving should be proportionate to the research significance of the output and must comply with confidentiality obligations, consent conditions, institutional retention policies, contractual restrictions, and applicable data protection requirements.

03 · What You Need to Know

Why AI-Generated Outputs Can Become Essential Research Records

When Does an AI Output Become Part of the Research Record?

A research record is not limited to the final dataset or published manuscript. It may also include the information needed to establish how observations were processed, how analytical decisions were made, and how reported results were obtained.

When an AI system contributes to these processes, its outputs may become consequential research artifacts.

For example, an AI-generated classification can become a variable in a quantitative dataset. An extracted numerical value can enter a meta-analysis. A generated screening recommendation may influence whether a study is included in a literature review.

In these situations, the original output provides evidence of the AI's contribution to the analytical procedure.

Preserving only the final corrected dataset may allow subsequent calculations to be repeated, but it may not reveal what the model originally produced or how researchers intervened.

The appropriate retention standard should reflect the output's role in the research and the applicable institutional or funder requirements.

Which AI Outputs Should Researchers Prioritize for Archiving?

The strongest case for archiving arises when AI-generated material directly influences the evidence supporting a research claim.

AI Output Research Significance Recommended Record
Extracted research variables May enter quantitative analysis Original extraction, source reference, and verified value
Qualitative classifications May determine coding frequencies or themes Original labels, input identifiers, and adjudications
Study-screening recommendations May affect inclusion or exclusion decisions AI recommendation, criteria, and final human decision
Generated analytical code May transform data or calculate results Code versions, tests, and execution results
AI-generated interpretations May influence substantive conclusions Consequential outputs and researcher verification records
Routine wording suggestions Usually do not constitute analytical evidence Retention according to institutional and project requirements

This distinction is not based simply on whether AI was used. It concerns whether the output influenced the research process in a way that another researcher might need to examine.

For instance, an AI-generated alternative title may have little bearing on reproducibility. An AI-generated decision to exclude a potentially eligible study from a systematic review may be methodologically consequential.

Why Saving the Prompt Is Not Enough

A prompt records what researchers asked the model to do. It does not establish what the model actually returned.

Generative AI systems may produce different outputs across repeated executions. Differences can arise from sampling, model configuration, context, computational behavior, or changes to the deployed system.

Consequently, repeating an identical prompt does not guarantee the original response.

Archiving the output preserves the observed result of the original execution rather than requiring a future researcher to regenerate it.

This is particularly valuable when the output was subsequently edited, corrected, rejected, or combined with other analytical information.

Prompt record Documents the instructions and contextual information supplied to the AI system.
Output record Documents what the AI system actually generated during a particular execution.
Decision record Documents how researchers accepted, corrected, rejected, or interpreted the generated material.

These records serve complementary purposes. Preserving one does not necessarily make the others unnecessary.

What Information Should Accompany an Archived AI Output?

An isolated AI response may be difficult to interpret without information about the conditions under which it was generated.

For consequential analytical uses, a useful archive may contain:

  • A unique identifier connecting the output to its source observation or document.
  • The exact prompt or prompt-version reference used for generation.
  • The relevant input data or a secure reference to those data.
  • The AI provider, model identifier, and available version information.
  • The execution date and relevant generation settings.
  • The original output in a format that preserves its substantive content.
  • Any errors, refusals, incomplete responses, or validation failures.
  • Human corrections, exclusions, and reasons for consequential decisions.

When the output is generated through an API, structured response records may be preferable to manually copied text because they can preserve identifiers and reduce transcription errors.

For conversational interfaces, exports may be useful, but researchers should verify whether they include the complete relevant context, attachments, and outputs.

Researchers should also preserve the analytical prompts and their versions so each output can be connected to the instructions that produced it.

Should Researchers Archive Every AI Response or Only the Final Accepted Output?

The answer depends on whether intermediate responses influenced the analytical procedure.

Suppose a researcher submits an interview excerpt to an AI model three times, receives three classifications, and selects one after reviewing the source material.

If the final classification is preserved but the other responses are discarded, the record may conceal disagreement that influenced the researcher's decision.

When repeated generations are part of the analytical method, preserving all outputs included in that procedure is generally advisable.

However, retaining every exploratory interaction may be unnecessary, particularly when those interactions did not contribute to the final method or findings.

The distinction should be established in the project's documentation plan rather than decided retrospectively according to which outputs appear useful.

Why AI Output Archives Matter When Models Are Updated or Retired

Commercial AI providers may update, replace, or discontinue models. Even a documented model identifier does not guarantee permanent access to the original system.

When model changes prevent exact reproduction, archived outputs may be the only surviving direct record of the original generation stage.

For example, researchers may still reproduce statistical analyses from preserved AI-generated classifications even if they can no longer obtain the same classifications from the original model.

This does not establish that the model's original behavior can be reproduced. It establishes that the analytical artifacts produced during the original execution remain available for examination.

Archiving therefore supports an important distinction between reproducing the generation process and reproducing the downstream analysis.

Where Should AI Outputs Be Stored?

The appropriate storage location depends on the sensitivity of the material, institutional requirements, and whether the archive is intended for internal verification or public reuse.

Possible arrangements include institutionally managed research storage, access-controlled repositories, encrypted project storage, or public research repositories when disclosure is permitted.

For shareable datasets, repositories such as Zenodo or institutional repositories may support persistent identifiers and versioned records. However, a public repository is not appropriate merely because the material is useful for reproducibility.

Researchers should distinguish between preserving an artifact and making it openly accessible. Sensitive records can sometimes be retained securely while access is restricted to authorized reviewers or researchers.

How Should Confidential or Personal Data Be Handled?

AI outputs may reproduce personal information, confidential source material, unpublished findings, or other protected content supplied during generation.

Even when inputs are anonymized, generated outputs may contain combinations of details that create reidentification risks.

Researchers should evaluate applicable consent conditions, research ethics approvals, institutional data management policies, contractual obligations, and data protection laws before retaining or sharing such material.

In the Philippines, for example, the Data Privacy Act of 2012 establishes obligations concerning the processing of personal information. Whether particular research records can be retained or disclosed depends on the relevant legal basis, safeguards, and circumstances.

Where full outputs cannot be shared, researchers may preserve them in restricted storage and provide appropriately deidentified or summarized records for wider examination.

Data minimization also matters. Researchers should avoid retaining unnecessary sensitive content merely because an AI platform makes exporting conversations convenient.

How Long Should AI Outputs Be Retained?

There is no universal retention period that applies to every AI-assisted research project.

Retention requirements may depend on institutional policy, funding agreements, journal requirements, research ethics approvals, applicable law, and the type of data involved.

Researchers should consult the relevant authorities rather than assume that all AI records must be retained permanently or for a particular number of years.

For consequential analytical outputs, the retention plan should consider how long the research may need to be audited, verified, or defended.

When retention is no longer authorized or necessary, secure deletion or other institutionally approved disposition procedures may be appropriate.

Can Archived Outputs Establish That an AI-Assisted Method Was Valid?

Not by themselves.

An archived classification proves that a particular output was recorded. It does not establish that the classification accurately represents the source material.

Researchers still need suitable validation procedures, such as comparison with independently established reference labels, source verification, or documented human review.

An archive becomes more informative when it preserves both the original AI output and the evidence used to evaluate it.

This distinction is central to reproducibility in AI-assisted research. Traceability allows an analysis to be examined, but the quality of the analytical decisions must be assessed separately.

04 · A Practical Example

Archiving AI Classifications Used in an Educational Research Study

Hypothetical Example

Classifying 500 Student Reflections

A researcher uses generative AI to classify 500 anonymized student reflections about technology-supported learning.

Each reflection is assigned one of four predefined categories. The researcher subsequently reviews uncertain classifications and corrects those that do not meet the coding criteria.

The resulting dataset will be used to report category frequencies and examine associations with other study variables.

Step 1: Preserve the original outputs

For each reflection, the researcher saves the original AI classification, its input identifier, the prompt version, and the model information.

Step 2: Record human corrections

Suppose the researcher corrects 35 classifications after applying a documented coding protocol. The archive preserves both the original labels and the corrected labels, together with the reasons for changes.

Step 3: Preserve the final analytical dataset

The researcher creates a separate validated dataset containing the classifications used for statistical analysis. This prevents the original AI outputs from being silently overwritten.

Step 4: Store the records securely

The original reflections and detailed outputs are retained in institutionally approved restricted storage. A deidentified analytical dataset and documentation are prepared for sharing where permitted.

Step 5: Support later verification

If the original model becomes unavailable, an authorized researcher can still examine the recorded AI decisions, review the corrections, and reproduce the calculations based on the final dataset.

In this hypothetical example, 35 of the 500 classifications were corrected, representing 7% of the observations. This percentage describes the frequency of documented corrections, not necessarily the model's complete error rate.

The archive makes it possible to investigate the corrections and distinguish original model behavior from subsequent researcher judgment. Without that record, the final dataset would provide much less information about how the classifications were produced.

05 · What Researchers Often Get Wrong

Common Misunderstandings About Preserving AI Research Outputs

Misconception

Saving the Prompt Means the Output Can Always Be Recreated

Identical prompts may produce different responses, and the original model may become unavailable. The prompt documents the instructions but does not preserve the response actually generated.

Misconception

The Final Dataset Makes Original AI Outputs Unnecessary

A final dataset may support downstream calculations without revealing the original AI decisions or human corrections. Preserving both can improve traceability when those decisions are consequential.

Misconception

Every AI Conversation Must Be Archived Permanently

Retention should be proportionate to the research significance of the material and consistent with applicable requirements. Routine interactions may not require the same treatment as outputs that generate research measurements.

Misconception

Archiving Means Publishing Every AI Response Online

Preservation and public sharing are different activities. Confidentiality, consent, intellectual property, and data protection requirements may justify restricted access or prohibit public disclosure.

Misconception

An AI Conversation History Is Automatically a Complete Research Archive

Platform histories may omit relevant settings, external inputs, deleted interactions, or structured metadata. They may also be subject to retention limits. Researchers should verify whether the export contains the records necessary for their methodology.

Misconception

Archived AI Outputs Prove That the Research Findings Are Correct

An archive establishes what was recorded, not whether the output was accurate or the analytical method was valid. Independent verification remains necessary.

06 · What This Means for You

How to Decide What AI Outputs to Preserve

The most useful question is whether another researcher would need to examine the output to understand or verify the study's findings.

If the answer is yes, the output should ordinarily be included in the research record, subject to applicable retention and access restrictions.

A practical decision framework

If AI only suggests alternative wording
Verify the final manuscript and follow relevant disclosure and retention policies. Detailed output archiving may be unnecessary.
If AI generates classifications, extracted values, or screening decisions
Preserve the original outputs, relevant inputs, prompt versions, model information, and subsequent corrections.
If repeated AI runs are part of the analytical method
Retain the outputs included in the predefined comparison or aggregation procedure, including disagreements and failures.
If outputs contain confidential or personal information
Use approved restricted storage, apply appropriate safeguards, and determine what can legally and ethically be retained or shared.
If the original AI model may become unavailable
Prioritize preserving the original analytical artifacts and a complete record of how they contributed to the final findings.

Build Archiving Into the Workflow Before Generating Results

For substantial AI-assisted analyses, archiving should be part of the execution procedure rather than an activity postponed until manuscript preparation.

Where feasible, use structured records that automatically connect each input to its prompt version, model identifier, output, and validation status.

Maintain separate records for original AI outputs and researcher-approved analytical values. This makes it easier to identify corrections and prevents the original evidence from being overwritten.

Researchers should also consider file integrity checks, access permissions, and versioned backups where appropriate to the project's data management requirements.

Watch Out

Do not upload confidential research records to a public repository simply to demonstrate reproducibility. Determine the applicable permissions and safeguards first. A securely preserved, access-controlled archive may be more appropriate than unrestricted publication.

Preserving consequential AI outputs also provides a foundation for verifying an analysis when its original model is no longer available.

07 · A Quick Checklist

AI Research Output Archiving Checklist

Before completing an AI-assisted analysis, check:
Identify which AI outputs materially influenced the research data, analytical decisions, or conclusions.
Preserve original consequential outputs rather than retaining only corrected or summarized results.
Connect each output to its input identifier, prompt version, model identifier, and execution date.
Document relevant model settings, errors, refusals, and incomplete responses when they affect the analysis.
Preserve records of human corrections, exclusions, and adjudications.
Separate original AI outputs from the final validated dataset used in downstream analysis.
Verify applicable retention periods, consent conditions, confidentiality requirements, and institutional policies.
Use secure storage and appropriate access controls for sensitive or restricted material.
Confirm that authorized researchers can interpret the archive without relying on access to the original AI service.
08 · Frequently Asked Questions

Frequently Asked Questions About Archiving AI Outputs

Do researchers need to save every ChatGPT conversation used during a study?

Not necessarily. The priority is preserving interactions that materially influenced the research methodology, data, analysis, or interpretation. Applicable institutional and legal retention requirements may impose additional obligations.

Is saving the final AI-generated spreadsheet enough?

It may support reproduction of downstream calculations, but it may not reveal the original AI responses or subsequent corrections. For consequential analytical uses, preserving both original outputs and final validated values is generally preferable.

Should failed or incorrect AI responses also be archived?

Yes, when they formed part of the analytical procedure or influenced decisions. Omitting failures and disagreements can create a misleading record of model performance.

Can AI outputs containing participant information be publicly shared?

Only when sharing is legally and ethically permitted and appropriate safeguards are in place. Consent, research ethics conditions, data protection requirements, and reidentification risks must be considered. Restricted access may be necessary.

How long should AI-generated research outputs be retained?

There is no universal retention period. Researchers should follow applicable institutional policies, funding agreements, journal requirements, ethics approvals, and legal obligations.

Can an AI output archive replace the original model?

No. Archived outputs preserve the results of earlier executions but do not recreate the model itself. They may support verification and downstream reproducibility even when the generation process cannot be repeated.

Should AI-generated research code be archived too?

Yes, when the code contributes to the analysis. Preserve the executable code, relevant versions, tests, and results. The generated code should be independently reviewed because archiving does not establish correctness.

09 · The Bottom Line

Preserve the Evidence of What AI Actually Produced

The Bottom Line

AI-generated outputs that materially influence research findings should generally be archived because they provide evidence of what the model actually produced, including information that may be impossible to regenerate later.

The archive should connect outputs to their inputs, prompts, model configurations, and researcher decisions while respecting applicable retention and confidentiality requirements. Preserving these records improves traceability and supports independent verification without assuming that the original AI system will remain unchanged or accessible.

10 · Sources and Further Reading

Authoritative Sources on Research Data Preservation and AI Records

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes