03 · What You Need to Know
How to Use Generative AI Without Compromising Methodological Accuracy
Why is the Methods section different from other manuscript sections?
The Methods section documents the procedures and decisions that produced the study's evidence. Its purpose is to allow readers to evaluate how the research was conducted, assess potential limitations, and understand how the findings were generated.
Depending on the discipline and research design, methodological reporting may also support replication, reproducibility, transferability, or assessment of analytical credibility.
This makes factual precision particularly important. An inaccurate introduction may misrepresent the literature, but an inaccurate Methods section may misrepresent the research process itself.
AI can help communicate methodology clearly. It cannot establish that a procedure occurred merely because the procedure would have been appropriate.
What can AI appropriately help write?
AI-assisted methods drafting is most defensible when it begins with records of the study rather than a generic description of the research design.
| Methods component |
Potential AI assistance |
What must be verified |
| Research design |
Clarifying the description of the documented design |
Whether the design label accurately reflects the study |
| Participants and sampling |
Organizing eligibility, recruitment, and sampling details |
Actual recruitment procedures, sample size, and selection method |
| Instruments and measures |
Improving descriptions of questionnaires, tests, or equipment |
Instrument versions, scoring, validity evidence, and reliability information |
| Data collection |
Converting procedural notes into a chronological description |
What was done, when, by whom, and under what conditions |
| Data preparation |
Clarifying documented cleaning and transformation procedures |
Actual exclusions, coding, missing-data handling, and transformations |
| Data analysis |
Improving the explanation of completed analyses |
Statistical tests, models, assumptions, software, and analytical decisions |
| Ethical considerations |
Organizing verified approval and consent information |
Actual ethical review, permissions, and participant protections |
AI assistance should remain bounded by the information available. If a detail is missing, the appropriate response is to identify the omission for the researcher to resolve, not to supply a conventional procedure and present it as fact.
Why can AI-generated methodological details be especially misleading?
Generative AI has learned patterns from large quantities of text, including conventional descriptions of research methodology. It may therefore produce details commonly associated with a study design even when those details were not supplied.
For example, a model may associate survey research with pilot testing, Cronbach's alpha, expert validation, informed consent, or particular sampling methods. These may be legitimate methodological elements, but their appearance in similar studies does not establish that they occurred in yours.
The resulting paragraph may read naturally because it resembles published research. That familiarity can make invented details difficult to notice.
A researcher should distinguish between a model describing an actual procedure and a model suggesting a procedure that could have been used. Only the former belongs in the Methods section as a factual account.
What is the difference between describing and recommending a method?
Generative AI may be useful during research planning by suggesting possible methods, instruments, or analytical strategies. Those suggestions belong to a different stage of research than manuscript reporting.
Methodological recommendation
A possible procedure that the researcher may evaluate before or during the design and conduct of a study.
Methodological reporting
A factual description of procedures and decisions actually implemented in the research.
For instance, AI may recommend conducting a pilot study to assess questionnaire clarity. That recommendation does not authorize the researcher to state that a pilot study was conducted.
Similarly, suggesting multiple regression as a possible analysis does not mean that multiple regression was performed or that it was appropriate for the actual dataset.
This distinction is essential when using AI during both research planning and manuscript preparation. Recommendations can inform decisions, but reporting must reflect documented practice.
How should researchers prepare their methodological records for AI-assisted drafting?
Before requesting a draft, assemble the information needed to describe the study accurately. The relevant records depend on the research design but may include approved protocols, sampling documentation, instrument specifications, procedural logs, data dictionaries, analytical scripts, and ethical approval information.
For quantitative studies, the researcher may need to document variables, measurement scales, statistical procedures, software versions, model specifications, and decisions about missing data.
For qualitative studies, relevant documentation may include recruitment procedures, interview guides, recording and transcription methods, coding procedures, analytic memos, and the researcher's role in interpretation.
For experimental research, details about allocation, interventions, comparison conditions, timing, blinding where applicable, and deviations from the protocol may be essential.
These records provide a factual foundation. AI may help organize their description, but the researcher must determine which details are accurate, necessary, and appropriate for the intended publication.
Can AI help identify missing methodological information?
Yes. A useful application is asking AI to compare a draft Methods section with an established reporting checklist and identify information that appears absent or unclear.
For example, a draft describing a survey study might omit how participants were recruited or how missing responses were handled. AI may flag these omissions and suggest questions for the researcher to answer.
However, identifying a missing detail is different from supplying it. The researcher should consult the original records and determine whether the information can be reported accurately.
Reporting guidelines can support this process. Depending on the design, researchers may consult CONSORT for randomized trials, STROBE for observational studies, PRISMA for systematic reviews, or other relevant guidelines available through the EQUATOR Network.
These guidelines are not interchangeable, and journal requirements may vary. A checklist should help improve reporting completeness rather than encourage researchers to claim procedures they did not perform.
Can AI help describe statistical analysis?
AI may help translate documented analytical procedures into clearer language. For example, it can assist with explaining which variables entered a regression model, how a statistical test was specified, or what software was used.
But a model can also confuse statistical procedures or introduce assumptions that were never checked. It may describe a paired-samples test when independent groups were compared, or report that normality was confirmed without any corresponding diagnostic analysis.
Researchers should verify the final wording against actual analysis scripts, software output, statistical decisions, and documented assumption checks.
Where AI contributes to generating analysis code or conducting analysis itself, its role may need to be reported as part of the research methodology rather than treated solely as manuscript-writing assistance.
The same evidential distinction applies when using AI to draft the Results section. The description must correspond to what the analysis actually produced.
What if the original research records are incomplete?
Incomplete records create a reporting problem that generative AI cannot legitimately solve by filling gaps with plausible details.
If the researcher cannot establish the exact version of an instrument, the timing of a procedure, or how missing observations were handled, the appropriate response is to investigate the available documentation.
Sometimes the information can be recovered from protocols, correspondence, software logs, or archived materials. In other circumstances, the uncertainty may need to be acknowledged as a limitation or resolved through consultation with collaborators.
Researchers should not retrospectively describe a procedure as completed merely because it would have been methodologically desirable.
Watch Out
Never use AI-generated text to manufacture ethical approval, participant consent, instrument validation, reliability results, randomization, assumption checks, or analytical procedures. Such statements concern the actual conduct of research and must be supported by authentic records.
How do publisher policies apply to AI-assisted methods writing?
Publisher guidance commonly distinguishes AI used to prepare manuscript language from AI used as part of the research process.
ICMJE recommends that AI assistance with writing be disclosed in the appropriate manuscript section, while AI used for data collection, analysis, or figure generation should be described in the Methods section. Its guidance emphasizes that human authors remain responsible for accuracy and integrity.
Elsevier's updated generative AI policy similarly distinguishes manuscript preparation from research-related AI use. AI used in research design, methods, data collection, analysis, or interpretation should be documented in a reproducible manner, while substantive manuscript-preparation assistance is subject to disclosure requirements.
Springer Nature applies a risk-based framework to AI-assisted manuscript preparation. It distinguishes language improvements from substantive drafting and prohibits independently generated scientific content that lacks a verifiable foundation.
Researchers should therefore identify what AI actually did. Helping rewrite a documented sampling procedure is different from selecting the sampling method, processing participant data, or conducting statistical analysis.
Policies change, and individual journals may impose additional requirements. The target journal's current instructions remain essential.
Should AI-generated Methods text be checked differently from ordinary editing?
Yes, because methodological errors may be concealed by otherwise fluent prose. Reviewing grammar and clarity is insufficient when a sentence makes a factual claim about the study.
A useful verification approach is to examine each methodological statement and identify the record supporting it. Statements about participants should correspond to recruitment and sampling documentation. Statements about instruments should match the materials used. Descriptions of analyses should match actual computational procedures.
Researchers should also check whether AI has changed technical terminology. Replacing "purposive sampling" with "random sampling," for example, is not a stylistic improvement. It changes the reported design.
Such risks are part of the broader problem of AI introducing new facts during scientific editing. Every substantive addition or alteration needs an evidential basis.