Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Should Researchers Avoid AI When Confidential Research Data Cannot Be Protected?

Researchers should not enter confidential research data into an AI system unless the transfer is authorized and appropriate protections are established. Learn how to evaluate confidentiality risks, consent limitations, provider arrangements, and safer research workflows.

1147
AI and Confidential Research Data Guide 1147 of 1196
01 · The Question

Should Researchers Use AI if They Cannot Guarantee Confidentiality?

A researcher has completed interviews with university students about sensitive personal experiences. The transcripts are lengthy, and a generative AI tool could potentially accelerate coding, summarization, and identification of preliminary themes. Uploading the material would be convenient, but the researcher does not know whether the service retains inputs, permits provider access, or uses submitted information for model improvement.

Another researcher wants AI to analyze an unpublished institutional dataset covered by a confidentiality agreement. The data contain no participant names, but combinations of demographic characteristics and organizational details could still reveal identities.

Can these researchers proceed if they intend to use AI only for legitimate academic purposes? Would removing names be sufficient? And what if the system promises that conversations are private?

The central issue is whether the proposed processing can satisfy the confidentiality, privacy, and authorization obligations governing the research information.

02 · The Short Answer

Do Not Transfer Confidential Data Without Authorization and Adequate Protection

In Brief

Researchers should avoid entering confidential research data into an AI system when they cannot establish that the processing is authorized and that appropriate confidentiality, privacy, and security protections are in place. Research convenience does not justify exposing restricted information to an unsuitable service.

This does not necessarily prohibit all AI-assisted analysis of confidential data. An institutionally approved system with appropriate access controls, contractual safeguards, and research authorization may be suitable. The decision depends on the information, processing arrangement, applicable obligations, and residual risks rather than whether the tool is described as public, private, or enterprise-grade.

03 · What You Need to Know

How AI Use Can Affect Confidentiality and Research Data Protection

Confidential Research Data Are Not Limited to Names and Contact Details

Researchers often associate confidential information with obvious identifiers such as names, student numbers, addresses, or medical record numbers. Yet research confidentiality can extend much further.

Interview transcripts may contain distinctive personal experiences, employment histories, institutional roles, locations, or combinations of circumstances that permit someone to recognize a participant. A dataset may also contain unpublished institutional information, proprietary methods, commercially sensitive records, or material subject to contractual restrictions.

Confidentiality concerns therefore extend beyond whether a file contains a column labeled "Name."

The relevant question is whether the information is subject to restrictions on access, use, processing, or disclosure. Those restrictions may arise from informed consent, research ethics approval, institutional policy, contractual agreements, or applicable law.

Uploading Data to AI May Introduce an Additional Processing Party

When researchers submit material to an externally hosted AI service, information may be processed through infrastructure operated by a provider or its authorized subprocessors.

The precise arrangement depends on the service, subscription, deployment model, and applicable agreement. Some services provide contractual data-processing protections and controls over retention or model training. Others may offer different arrangements.

Researchers should establish who receives or processes the information, for what purposes, under which contractual conditions, and with what technical protections.

Even where the provider does not use customer data to train its models, questions may remain about retention, access, logging, subprocessors, and permitted data transfers.

A promise not to train on submitted information addresses one potential concern. It does not, by itself, establish comprehensive confidentiality protection.

Why Removing Names May Not Be Enough

De-identification and anonymization are related but distinct concepts.

De-identification Reducing or removing identifying information to lower the likelihood that individuals can be recognized, while acknowledging that residual identification risks may remain.
Anonymization Processing information so that individuals are no longer identifiable under the applicable legal and technical standard, taking account of reasonably available means of identification.

Replacing names with participant codes may reduce direct identification, but distinctive combinations of attributes can still reveal identities.

For example, an interview excerpt referring to the only female dean in a small institution, a specific disciplinary incident, and a particular academic year may be recognizable even without a name.

Researchers should assess contextual identifiers, linkability with other information, and the possibility of reidentification. Pseudonymized data may remain personal data under applicable law.

Where effective anonymization cannot be established, the information should continue to be handled according to the protections required for identifiable or potentially identifiable research data.

Does Participant Consent Permit AI Processing?

Consent to participate in research does not necessarily authorize every subsequent form of data processing.

A participant may agree to have an interview recorded and analyzed by an approved research team without agreeing to have the transcript transferred to an external generative AI provider.

Whether additional consent, an ethics amendment, or another lawful authorization is required depends on the original consent materials, approved protocol, applicable law, and nature of the proposed processing.

In some circumstances, processing may rely on a lawful basis other than consent. Researchers should not assume, however, that an existing lawful basis automatically covers every new AI workflow.

When the proposed use materially differs from the approved arrangements, consult the responsible ethics or data protection authority before transferring the information.

What Does the Philippine Data Privacy Act Mean for AI-Assisted Research?

For research involving personal information subject to Philippine law, Republic Act No. 10173, the Data Privacy Act of 2012, and its implementing rules provide an important legal framework.

The Act establishes general data privacy principles, including transparency, legitimate purpose, and proportionality. It also addresses lawful processing, sensitive personal information, security measures, and accountability.

Research-related provisions and exceptions must be interpreted in their proper legal context. The fact that information is collected for academic research does not create a universal exemption from data protection obligations.

Researchers should identify the applicable lawful basis, determine the responsibilities of the relevant personal information controller and processor, and assess whether external AI processing is consistent with the authorized purpose and required safeguards.

The National Privacy Commission provides official guidance and issuances relevant to these obligations. Institutional data protection officers should be consulted where necessary.

For international projects, additional requirements may arise under other jurisdictions, including the European Union's General Data Protection Regulation where applicable.

What Protections Should Be Established Before Using AI?

The necessary safeguards depend on the sensitivity of the information and the proposed processing arrangement.

Potential measures include institutional approval, a suitable data-processing agreement, defined access permissions, encryption, retention controls, documented subprocessors, restrictions on secondary use, and procedures for responding to security incidents.

These measures should be evaluated together. Encryption during transmission does not eliminate risks associated with provider access or authorized processing after the information reaches the service.

Likewise, a private account does not necessarily provide the same protections as an institutionally managed environment governed by a negotiated agreement.

Protection What it addresses What still needs checking
Institutional authorization Whether the proposed use is permitted Scope of approval and any conditions
Data-processing agreement Provider responsibilities and contractual controls Permitted purposes, subprocessors, retention, and transfers
Access controls Who can access research information Administrative privileges, authentication, and audit records
Encryption Protection of information in specified states Key management and access after decryption
Retention and deletion controls How long information is kept Logs, backups, exceptions, and contractual commitments
Data minimization Limiting information exposed to the system Whether remaining details are still identifying or restricted

No single safeguard establishes that a workflow is appropriate. Researchers should evaluate whether the combined protections meet the project's actual obligations.

When Is a Locally Hosted AI Model Safer?

A locally deployed model may reduce some risks associated with transferring research information to an external provider, particularly when processing occurs within an approved institutional environment.

However, local deployment is not automatically secure.

The system may still contain vulnerabilities, generate logs, permit unauthorized access, or depend on external services for updates, monitoring, or other functions. Researchers must also consider model reliability, system maintenance, and the institution's capacity to manage the environment.

A properly governed local deployment may be preferable for some confidential tasks, but its suitability should be established through an actual security and research assessment.

Can Synthetic Data Be Used Instead?

Synthetic or fictional data can be useful for testing prompts, exploring code structures, and evaluating preliminary workflows without exposing actual participant records.

For example, researchers may create fictional interview excerpts to test whether an AI system can produce a desired output format before considering any authorized use with real data.

However, synthetic data generated from confidential datasets can sometimes retain sensitive patterns or information. Their privacy properties should not be assumed merely because they are labeled synthetic.

More importantly, successful performance on fictional examples does not establish validity on actual research data. Differences in language, context, complexity, and population characteristics may affect results.

Synthetic material is therefore useful for preliminary development but should not be treated as a complete substitute for task-specific validation.

What if the Researcher Has Already Uploaded Confidential Data?

If potentially unauthorized processing has already occurred, the researcher should preserve relevant facts and promptly follow the institution's applicable incident-reporting procedures.

Relevant information includes what was submitted, when it was submitted, which service was used, the account and contractual arrangement, and whether the information contained personal or otherwise restricted material.

Researchers should not assume that deleting a conversation necessarily removes every retained copy or eliminates an earlier disclosure.

The institution's data protection, information-security, ethics, or legal personnel may need to determine whether containment, provider communication, participant notification, or regulatory reporting is required.

These decisions depend on the actual incident and applicable obligations. Researchers should avoid independently promising that no breach occurred before an appropriate assessment has been completed.

04 · A Practical Example

Deciding Whether to Upload Confidential Student Interviews to AI

Hypothetical Example

A Study of Students' Experiences With Academic Misconduct Proceedings

A research team conducts 24 confidential interviews with university students who have participated in academic misconduct investigations. The transcripts include descriptions of disciplinary cases, family circumstances, and interactions with identifiable university personnel.

The team wants to use a general-purpose online AI chatbot to generate preliminary qualitative codes. The approved protocol specifies restricted research-team access but does not authorize processing through the proposed external service.

Classify the information.

The researchers identify sensitive participant accounts and contextual information that could permit reidentification.

Examine the authorization.

The approved protocol and consent materials do not clearly cover the proposed external AI processing.

Assess the service.

The team cannot establish contractual protections or retention arrangements appropriate for the restricted material.

Make the decision.

The researchers do not upload the transcripts. They continue analysis within the approved research environment.

Consider future alternatives.

The team may seek ethics and information-security review of an institutionally approved AI system, with appropriate safeguards and methodological validation.

The decision does not imply that AI-assisted qualitative coding is scientifically unacceptable. It means that the proposed transfer cannot currently be justified under the project's confidentiality obligations.

Preserving participant trust and complying with the approved data-handling arrangements take precedence over possible reductions in coding time.

05 · What Researchers Often Get Wrong

Misconceptions About AI and Confidential Research Information

Misconception

Does Removing Names Make Research Data Safe to Upload?

No. Contextual identifiers and combinations of attributes may still permit reidentification. Researchers must evaluate residual privacy risks and applicable restrictions.

Misconception

Does a Provider's No-Training Policy Guarantee Confidentiality?

No. Model-training restrictions address only one aspect of data handling. Retention, access, subprocessors, security, and contractual obligations remain relevant.

Misconception

Does Research Consent Automatically Authorize External AI Processing?

No. Authorization depends on the consent materials, approved protocol, applicable legal basis, and proposed processing. Additional review or approval may be required.

Misconception

Is an Enterprise AI Subscription Automatically Suitable for Confidential Research?

No. Enterprise services may provide additional controls, but suitability depends on the actual agreement, configuration, information involved, and institutional requirements.

Misconception

Are Locally Hosted AI Models Always Secure?

No. Local deployment may reduce external transfer risks but still requires appropriate access controls, security maintenance, logging policies, and institutional governance.

Misconception

Can a Researcher Resolve an Unauthorized Upload by Deleting the Chat?

Not necessarily. Deletion from a user interface may not establish removal from every system or eliminate an earlier unauthorized disclosure. Applicable incident procedures should be followed.

06 · What This Means for You

Protect the Research Information Before Selecting the AI Tool

Begin with the data and the obligations governing them, not the features advertised by an AI provider.

If the information is confidential, determine whether the proposed processing is authorized. Then evaluate the provider's safeguards, institutional arrangements, and the residual risks.

Where the tool's data-use terms remain unclear, do not transfer restricted information merely to test whether the system is useful.

More broadly, deciding when not to use AI involves recognizing circumstances in which the available safeguards cannot support the proposed task.

A simple decision framework

If the data are public and their intended use is authorized
Evaluate the AI system's methodological suitability and any remaining legal or contractual restrictions.
If the data are confidential but an approved protected environment is available
Use the environment only within the scope of its authorization and required safeguards.
If authorization or adequate protection cannot be established
Do not submit the confidential information to the proposed system.
If a potentially unauthorized transfer has already occurred
Follow institutional incident procedures and preserve the information needed for assessment.

When the proposed processing could materially affect participants, consider the consequences of AI-related participant harm in addition to data security.

A responsible decision may involve changing the tool, restricting the information supplied, obtaining further authorization, or conducting the task without AI. Confidentiality is a condition of responsible research, not a feature that can be added after an unauthorized disclosure.

07 · A Quick Checklist

Before Entering Research Data Into an AI System

Verify the following:
Classify the information according to institutional, contractual, and applicable legal requirements.
Check whether the data contain direct, indirect, or contextual identifiers.
Review the consent materials, approved research protocol, and applicable lawful basis for processing.
Confirm that the proposed AI service and processing arrangement are authorized.
Examine contractual provisions concerning retention, access, subprocessors, and secondary use.
Evaluate technical safeguards, access controls, and relevant security responsibilities.
Minimize the information supplied without assuming that pseudonymization eliminates all risks.
Obtain any necessary ethics, privacy, or information-security review before processing.
Use an approved alternative when confidentiality cannot be adequately protected.
08 · Frequently Asked Questions

Frequently Asked Questions About Confidential Research Data and AI

Can researchers upload interview transcripts to ChatGPT?

Only when the proposed processing is authorized and the service arrangement provides protections appropriate to the information. Confidential or identifiable transcripts should not be uploaded merely because the researcher has access to the tool.

Is removing participant names enough to protect confidentiality?

Not necessarily. Contextual details and combinations of attributes can permit identification. Researchers should assess residual reidentification risks and applicable data protection requirements.

Can confidential data be used with an institutionally approved AI tool?

Potentially. Approval must cover the relevant information and processing purpose, with appropriate technical, contractual, ethical, and legal safeguards. Institutional approval of a tool does not automatically authorize every dataset.

Does a no-training guarantee mean an AI provider cannot access the data?

No. Restrictions on model training do not necessarily determine all access, retention, support, or security arrangements. The applicable service agreement and configuration must be reviewed.

Can researchers use synthetic data instead of confidential participant data?

Yes, synthetic examples can support preliminary testing. However, synthetic data derived from sensitive records may still present privacy risks, and performance on synthetic material does not establish validity on actual research data.

Does the Philippine Data Privacy Act prohibit all AI analysis of personal data?

No. The Act does not impose a universal prohibition on AI processing. Researchers must establish an applicable lawful basis and comply with relevant data protection principles, safeguards, and obligations.

What should I do if I already uploaded confidential research data to an unauthorized AI service?

Promptly follow institutional privacy or security incident procedures, preserve relevant facts, and seek appropriate guidance. Do not assume that deleting the conversation fully resolves the incident.

09 · The Bottom Line

Confidentiality Must Be Established Before AI Processing Begins

The Bottom Line

Researchers should not submit confidential research data to an AI system unless the processing is authorized and appropriate safeguards can protect the information throughout its intended use.

Removing names, purchasing a premium subscription, or relying on a general privacy assurance does not automatically establish compliance. When the necessary protections cannot be demonstrated, using an approved alternative or avoiding the proposed AI workflow is the more defensible research decision.

10 · Sources and Further Reading

Authoritative Guidance on Research Confidentiality and AI Data Protection

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes