03 · What You Need to Know
Why Scientific Defensibility Matters More Than AI Availability
Capability Does Not Establish Suitability
An AI system may be technically capable of producing an output without being suitable for the research task.
A language model can generate statistical code, but the resulting analysis may be inappropriate for the study design. It can summarize confidential interviews, but the processing arrangement may violate the conditions under which those interviews were collected.
Similarly, a model can produce classifications that appear consistent while lacking adequate validation for the population or construct being studied.
The distinction between capability and suitability is central to responsible tool selection.
Researchers should ask not merely whether AI can perform an operation, but whether it can perform that operation under conditions that satisfy the scientific and ethical requirements of the study.
What Does It Mean for AI Use to Be Scientifically Defensible?
A scientifically defensible procedure can be explained, justified, and critically evaluated using appropriate evidence and methodological standards.
For AI-assisted research, this generally means that the system's role is clearly defined, its suitability has been evaluated, and consequential outputs can be adequately verified or validated.
The researcher should also understand how the AI contribution affects the study's evidence and conclusions.
Scientific defensibility does not require absolute certainty. Research routinely operates under uncertainty, and even established methods have limitations.
The relevant requirement is that uncertainty be identified, evaluated, and managed sufficiently for the intended scientific claim.
Ethical Defensibility Is a Separate Requirement
A scientifically accurate AI procedure may still be inappropriate if its use violates research ethics or information-handling obligations.
For example, an AI system might correctly classify confidential participant interviews while processing those transcripts through an unauthorized external service.
The accuracy of the classifications would not resolve the confidentiality problem.
Similarly, an AI-assisted decision system may demonstrate strong aggregate performance while creating unacceptable risks for a vulnerable participant population.
Scientific and ethical defensibility should therefore be evaluated together, without assuming that success in one dimension compensates for failure in the other.
Why Some Requirements Cannot Be Traded Against Convenience
Researchers often make trade-offs among cost, efficiency, analytical complexity, and available resources.
However, not every requirement can be treated as a negotiable preference.
If a research protocol prohibits transferring participant information to an external provider, the prospect of faster analysis does not independently authorize that transfer.
If an AI-generated result cannot be adequately verified and directly determines a consequential scientific conclusion, convenience does not establish its reliability.
Likewise, where a system presents unacceptable risks of participant harm, higher productivity does not automatically make those risks permissible.
The decision should distinguish essential conditions from benefits that may be weighed against one another.
How Do Reliability, Authorization, and Accountability Interact?
Reliability concerns whether the system performs adequately for the intended task. Authorization concerns whether the proposed processing and use are permitted. Accountability concerns whether responsible researchers can explain, evaluate, and answer for the resulting work.
These dimensions are related but not interchangeable.
Reliability
Whether the AI-assisted procedure produces sufficiently accurate and dependable results for the intended purpose.
Authorization
Whether the proposed use complies with applicable ethical, legal, institutional, contractual, and publication requirements.
Accountability
Whether responsible researchers can explain the procedure, evaluate its limitations, and take responsibility for the resulting scientific work.
A workflow may satisfy two of these dimensions while failing the third.
For example, an accurate and well-documented analysis may still be impermissible if it involves unauthorized processing of confidential information.
Similarly, an authorized AI tool may produce unreliable results when applied outside the conditions for which it was evaluated.
Researchers should not assume that institutional approval of a tool establishes scientific validity for every application.
Why Human Responsibility Cannot Be Delegated to AI
AI can assist with scientific work, but it does not assume the responsibilities of an accountable human researcher.
Researchers remain responsible for the methods they report, the evidence they present, and the interpretations they defend.
This does not mean researchers must personally perform every computational operation. Scientific work routinely involves software, instruments, technical specialists, and collaborators.
However, the final research process must remain sufficiently understandable and accountable to those responsible for the study.
If a researcher cannot explain why an AI-generated method was selected or how its outputs were validated, the problem is not resolved by describing the system as sophisticated or widely used.
What Does the NIST AI Risk Management Framework Contribute?
The National Institute of Standards and Technology's AI Risk Management Framework provides a structured approach to considering AI risks and trustworthiness.
It identifies characteristics such as validity and reliability, safety, security and resilience, accountability and transparency, explainability and interpretability, privacy protection, and fairness.
The framework emphasizes that these characteristics must be evaluated in relation to the system's context of use. It also recognizes that trade-offs may arise among them.
Importantly, the framework treats the decision to deploy AI as a contextual assessment of risks, impacts, costs, and benefits rather than assuming that AI should be adopted whenever technically feasible.
For researchers, this supports a task-specific justification rather than a universal preference for AI adoption.
Why UNESCO Emphasizes Human-Centred AI Use
UNESCO's Guidance for Generative AI in Education and Research addresses the need to protect human agency, data privacy, and ethical responsibility while evaluating possible educational and research applications.
The guidance also emphasizes institutional capacity to assess the suitability of generative AI systems and the importance of contextually appropriate validation.
These principles are relevant because research use should be determined by scientific and human requirements rather than by the capabilities advertised by technology providers.
For example, an AI system may be capable of producing educational research interpretations, but the researcher must still evaluate whether those interpretations respect the study's methodology and evidence.
A human-centred approach does not imply rejecting automation. It means retaining meaningful human responsibility for consequential decisions.
Why There Is No Universal Ranking of Reasons to Avoid AI
Researchers may encounter different decisive limitations depending on their work.
For a confidential qualitative study, unauthorized data processing may be the principal reason to avoid a particular AI service.
For a statistical analysis, the inability to verify generated calculations may be decisive.
For a longitudinal study, uncontrolled model changes may undermine measurement comparability.
For a participant-facing intervention, the possibility of serious harm may outweigh an otherwise attractive efficiency gain.
These circumstances cannot be reduced to a universally valid hierarchy without considering the research context.
The overarching criterion is whether essential requirements can be satisfied. The particular reason for declining AI depends on which requirement remains unmet.
When Is a Lack of Scientific Benefit Enough to Reject AI?
AI does not necessarily need to improve the scientific findings directly to be useful.
Reliable time savings, improved accessibility, or reduced administrative workload may provide legitimate practical benefits.
However, when AI introduces additional uncertainty, verification burdens, or technical dependencies without a meaningful compensating benefit, the rationale for adoption becomes weak.
For example, a researcher may have no reason to replace a validated statistical calculation with a generative response that requires the same calculation to be repeated for verification.
In that case, avoiding AI may be justified by unnecessary complexity rather than an unacceptable safety risk.
The strength of the justification should be proportionate to the significance of the task.
Can AI Be Used When Some Uncertainty Remains?
Yes. Scientific methods rarely eliminate all uncertainty.
An AI-assisted classifier may be appropriate when its error characteristics are sufficiently understood, the research design accommodates uncertainty, and relevant safeguards are established.
Likewise, AI-generated suggestions may support exploratory thinking without being treated as verified findings.
The question is whether the remaining uncertainty is acceptable for the intended use.
For low-consequence brainstorming, substantial output variability may be manageable. For participant safety decisions or primary research measurements, the required assurance may be considerably greater.
Researchers should avoid presenting uncertainty as either universally disqualifying or scientifically irrelevant.
How Can Researchers Make a Defensible Go-or-No-Go Decision?
A practical decision process begins by defining the proposed AI task and identifying the conditions that must be satisfied before the system can be used.
Researchers should then evaluate the available evidence for the system's suitability, the applicable authorization, the verification procedure, and the consequences of failure.
Where an essential condition remains unmet, the task should not proceed in its proposed form.
Where the conditions are satisfied, the researcher can compare AI with available alternatives and determine whether the expected benefits justify the remaining costs and uncertainty.
| Question |
If the answer is no |
Possible response |
| Is the proposed use authorized? |
The workflow may violate an applicable obligation |
Do not proceed until permission or an authorized alternative is established |
| Can consequential outputs be adequately verified? |
The scientific result may be unsupported |
Obtain independent validation or use another method |
| Can foreseeable harms be adequately controlled? |
Participants or others may face unacceptable risks |
Do not deploy the consequential function |
| Can the method be understood and defended? |
Scientific accountability may be inadequate |
Obtain expertise, revise the procedure, or select another method |
| Can essential records be preserved? |
The procedure may lack sufficient traceability |
Improve documentation or choose a better-supported system |
| Does AI provide a meaningful benefit? |
The additional complexity may be unnecessary |
Prefer a simpler defensible alternative |
This is a practical decision aid, not a formally validated scoring instrument. Some failures require stopping the proposed activity, while others may be resolved through additional validation, training, or changes to the workflow.
When Should Researchers Reconsider an Earlier Decision Not to Use AI?
A decision to avoid AI need not be permanent.
A provider may introduce stronger data protection arrangements, a model may become better documented, or independent validation may establish adequate performance for a particular task.
Researchers may also acquire additional methodological expertise or obtain institutional approval for a previously restricted activity.
When circumstances change, the proposed use can be reassessed against the same scientific and ethical requirements.
The decision should not change merely because the technology becomes more popular. It should change because relevant evidence or conditions have improved.
Why Declining AI Can Be a Positive Scientific Decision
Researchers sometimes interpret non-adoption as technological resistance or a missed opportunity.
Yet scientific methodology routinely involves rejecting procedures that are unsuitable for the research question, insufficiently validated, or incompatible with ethical obligations.
Choosing not to use AI can reflect careful evaluation of alternatives and a deliberate commitment to methodological defensibility.
It may also preserve resources that would otherwise be spent validating a tool whose contribution is unnecessary.
The quality of the decision depends on its justification, not on whether the final workflow includes AI.