Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Can Synthetic Data Replace Real Participant Data in Research?

Synthetic data can replace real participant records for certain methodological tasks, but they generally cannot substitute for genuine human participation when a study aims to understand actual experiences, attitudes, or behaviors. Learn where synthetic data are useful, what claims they can support, and why empirical validation remains important.

861
Can Synthetic Data Replace Real Participants? Guide 861 of 1196
01 · The Question

Can Researchers Use Synthetic Data Instead of Recruiting Real Participants?

Recruiting research participants can be difficult. Some populations are hard to reach, sensitive information may be restricted, and data collection can require substantial time and resources.

Generative artificial intelligence can produce artificial survey responses, interview transcripts, and behavioral records that resemble information researchers might obtain from real people.

Could these generated records replace participant data? If an AI system produces plausible responses from hundreds of hypothetical students, teachers, or patients, can researchers use those responses to answer questions about the corresponding human populations?

The answer depends on what the research seeks to establish. Synthetic data may replace real records for certain computational tasks, but replacing the data file is not the same as replacing the empirical evidence supplied by actual participants.

02 · The Short Answer

Synthetic Data Can Replace Real Records for Some Tasks, but Not Automatically Real Human Evidence

In Brief

Synthetic data can substitute for real participant records in some research activities, including software testing, methodological development, simulation, and certain model-development workflows. However, synthetic observations generally cannot replace genuine human participation when the study aims to establish what actual people experienced, believed, reported, or did.

Artificial records may reproduce selected statistical characteristics of empirical datasets, but they do not create additional human observations. Whether synthetic data are appropriate depends on the research question, generation method, validation, and the claims researchers intend to make.

03 · What You Need to Know

When Synthetic Data Can and Cannot Substitute for Human Participant Data

What does replacing participant data actually mean?

The phrase can refer to several different activities.

A researcher may replace an identifiable dataset with a synthetic version for software testing or controlled data sharing.

Another researcher may generate artificial responses before collecting genuine participant data to test a questionnaire or analytical workflow.

A third may attempt to replace participant recruitment entirely by asking an AI system to simulate how people would respond.

These uses have different methodological implications.

Replacing the data used by software does not necessarily mean replacing the empirical evidence needed to answer a research question.

The distinction is particularly important when the study concerns human experiences, attitudes, or behavior.

Why are synthetic participants not equivalent to real participants?

A genuine participant contributes information through an actual research interaction or observation.

For example, a teacher interviewed about digital learning describes experiences arising from professional practice. A student completing a questionnaire provides responses influenced by personal circumstances and interpretation of the questions.

An AI-generated participant does not independently possess those experiences or participate in the study as a human respondent.

Its answers are generated through computational processes conditioned on training data, prompts, and model behavior.

Real participant data Evidence obtained from actual people through documented research procedures.
Synthetic participant data Artificial records generated to resemble or simulate selected characteristics of human responses.

Even when synthetic responses resemble empirical observations, they do not establish that the corresponding people participated or expressed those views.

When can synthetic data replace real participant records?

Synthetic data may substitute for genuine records when the task does not require new evidence about actual participants.

Research task Can synthetic data substitute? Important qualification
Testing statistical analysis code Often yes Artificial records must exercise the relevant software conditions.
Developing survey data-processing workflows Often yes Successful testing does not establish questionnaire validity among humans.
Evaluating statistical methods through simulation Yes, when justified Findings remain conditional on the simulation assumptions.
Training prediction models Potentially Real-world performance requires appropriate independent validation.
Sharing substitutes for sensitive datasets Potentially Statistical utility and privacy risks must be assessed.
Measuring actual population attitudes Generally no Generated responses are not independent empirical observations.
Documenting lived experiences through interviews No, not as equivalent testimony AI-generated narratives do not establish actual human experiences.
Estimating intervention effects in real participants Not without an appropriate empirical basis Simulated outcomes cannot independently establish observed treatment effects.

The appropriate substitution depends on the evidentiary requirements of the task.

Synthetic data can be highly useful for developing a method without being suitable for answering the substantive empirical question that the method will eventually investigate.

Can AI-generated survey responses replace actual respondents?

Not when the research intends to report genuine survey participation or establish observed population attitudes.

For example, generating 300 artificial student responses does not mean that 300 students completed a questionnaire.

The artificial records may be useful for testing survey logic, data-processing code, or analytical procedures.

However, they cannot independently establish how actual students perceive online learning.

Research examining language-model simulations of human responses has explored whether models can reproduce selected population-level patterns.

Such findings should not be interpreted as demonstrating that AI-generated respondents reliably replace actual participants across populations, contexts, and question types.

The question of whether AI can predict population survey responses requires independent validation and attention to generalizability.

Can synthetic interview transcripts replace real qualitative interviews?

Not when the objective is to document actual human experiences.

Generative AI can produce plausible narratives, quotations, and conversational responses, but these outputs are not testimony from people who participated in the study.

For example, an AI-generated account of a teacher struggling with internet connectivity may sound credible. It does not establish that any particular teacher experienced the described situation.

Such material may support interviewer training, pilot testing, or coding exercises when clearly identified as simulated.

However, presenting fictional transcripts as genuine interviews constitutes fabrication under applicable research-misconduct definitions.

The distinction involving AI-generated fictional participants and interview transcripts is especially important in qualitative research because the origin and context of testimony are central to interpretation.

Can synthetic data replace sensitive participant records for data sharing?

Potentially. Synthetic datasets may allow researchers to share artificial records that reproduce selected characteristics of sensitive empirical data without distributing the original participant-level observations.

For example, a research team might release a synthetic version of a restricted dataset to support preliminary software development or methodological exploration.

However, the artificial dataset may not preserve every property needed for downstream analysis.

It may also retain information that creates privacy risks, particularly when the generation model closely reproduces distinctive source records.

Researchers should evaluate both statistical utility and disclosure risk.

The use of synthetic data for participant privacy should not be interpreted as a guarantee that artificial records are anonymous or safe to release.

Can synthetic data help when participant recruitment is difficult?

They may help with methodological preparation, but they do not automatically resolve the absence of empirical participants.

Researchers may use artificial responses to test instruments, develop analysis code, or investigate possible study designs while recruitment continues.

However, if the research question requires actual participant evidence, recruitment challenges remain a methodological limitation.

Researchers may need to revise the study design, extend recruitment where feasible, adjust the scope of the claims, or report the achieved sample transparently.

Generating fictional participants to satisfy a recruitment target would misrepresent the study if those records were reported as genuine participation.

The legitimacy of synthetic data in research depends on whether the artificial observations are appropriate for the task rather than whether they are convenient.

Can synthetic data establish the reliability or validity of a questionnaire?

Not in the same way as evidence obtained from actual respondents.

Researchers may calculate reliability coefficients or examine factor structures using synthetic questionnaire data, but those results describe the generated records and their underlying assumptions.

They do not independently establish that the instrument measures the intended constructs reliably among real participants.

For example, an AI-generated dataset may exhibit high internal consistency because the generation process was instructed to create strongly related items.

That does not demonstrate that actual students would interpret and respond to the questionnaire in the same way.

Evidence concerning response processes, construct validity, and score reliability generally requires appropriate empirical evaluation.

Synthetic data may support preliminary methodological testing without replacing that validation.

Can synthetic data replace real data for prediction-model training?

Under some circumstances, synthetic data may supplement or substitute for empirical records during particular stages of model development.

For example, artificial records may help test a model architecture or examine behavior under rare hypothetical conditions.

However, models trained on synthetic data may learn artifacts of the generation process rather than relationships that generalize to real populations.

Performance on artificial test data may therefore overestimate real-world effectiveness.

Independent validation using appropriate empirical data is generally important when the intended claim concerns real-world predictive performance.

The use of synthetic data in prediction-model development should be assessed in relation to the target population, deployment conditions, and potential harms from inaccurate predictions.

Can AI-simulated participants support behavioral research?

AI-simulated participants can be studied as outputs of computational models.

For example, researchers may investigate how language models respond to different demographic prompts or whether generated responses reproduce selected patterns found in human studies.

Such work can contribute to understanding model behavior and the limitations of simulation methods.

However, a simulated participant is not automatically an empirically representative human respondent.

Model outputs may depend on prompt wording, training data, model version, and the assumptions embedded in the simulation.

The question of AI-generated versus real participants in behavioral research requires distinguishing studies of AI behavior from studies making claims about actual people.

What happens if synthetic participants are reported as real?

The research record misrepresents the data collection process.

The United States Office of Research Integrity (ORI) defines fabrication as making up data or results and recording or reporting them.

For example, a manuscript claiming that 250 students completed a questionnaire when all 250 responses were generated by AI falsely represents the empirical sample.

Disclosing that AI assisted with analysis would not resolve the false claim about participant recruitment.

Researchers should distinguish synthetic observations from genuine data throughout storage, analysis, and reporting.

Formal findings of research misconduct require the applicable evidentiary and culpability standards to be satisfied, but the underlying misrepresentation remains a serious integrity concern.

How should researchers validate synthetic data intended to substitute for real records?

Validation should examine whether the artificial dataset preserves the properties necessary for the intended application.

For example, a synthetic dataset intended for software testing may need to reproduce variable formats, missing-data conditions, and relevant edge cases.

A dataset intended to approximate empirical observations may require evaluation of distributions, relationships among variables, subgroup characteristics, and downstream analytical performance.

Where the data are derived from sensitive source records, privacy risk should also be assessed.

However, validation against selected empirical properties does not establish that artificial records are equivalent to new human observations.

The process of synthetic-data validation should therefore address fitness for purpose rather than assume universal interchangeability.

Can a study be published without any real participants?

Yes, if the research question and design do not require genuine human participation.

For example, a study may evaluate statistical methods through simulation, investigate AI-generated behavior, or compare synthetic-data generation techniques.

Such research can make legitimate methodological or computational contributions.

However, the manuscript must accurately describe the artificial data and avoid implying that actual participants were recruited.

Findings about the behavior of an AI model should not automatically be generalized to human populations.

The issue is not whether a study contains real participants, but whether its evidence supports the claims it makes.

What should researchers report when synthetic data replace real records?

Researchers should explain why synthetic data were used and which functions they replaced.

Relevant documentation may include the generation method, reference data where applicable, model or software version, parameters, assumptions, validation procedures, and limitations.

The manuscript should distinguish artificial record counts from genuine participant numbers.

If synthetic data were used only for software testing, that role should be described without implying that the generated records contributed empirical evidence.

Where synthetic data were used in model development, researchers should explain how the resulting model was evaluated and whether independent empirical validation was performed.

Appropriate reporting of synthetic data in research papers helps readers understand both the value and limits of the artificial material.

04 · A Practical Example

Can Synthetic Students Replace Actual Students in an Online Learning Study?

Hypothetical Example

A study of online learning engagement

A researcher plans to investigate how perceived instructor support relates to student engagement in online courses.

The original design involves surveying university students about their actual learning experiences.

Because recruitment is difficult, the researcher considers generating 300 fictional student responses through AI.

The generated dataset contains plausible questionnaire ratings and a positive relationship between instructor support and engagement.

Step 1: Identify the substantive research question The study aims to understand relationships among variables in actual university students.
Step 2: Identify what the synthetic dataset represents The 300 artificial records are generated model outputs, not responses from recruited students.
Step 3: Evaluate the evidentiary limitation The generated correlation does not independently establish that the same relationship exists among actual students.
Step 4: Consider a legitimate alternative use The synthetic dataset may be used to test the questionnaire's data structure or the planned statistical-analysis workflow.
Step 5: Preserve the empirical research design The researcher collects genuine participant responses where required and reports the actual sample and limitations accurately.

The synthetic dataset may support methodological preparation, but it cannot replace the human evidence required by the original research question.

If the researcher instead chooses to study how AI simulates student responses, that would be a different research design requiring different claims and validation.

05 · What Researchers Often Get Wrong

Common Misconceptions About Replacing Human Data With Synthetic Records

Misconception

If Synthetic Responses Look Human, They Can Replace Participants

Realistic language or numerical patterns do not establish actual participation. Synthetic records remain generated outputs rather than independent human observations.

Misconception

AI-Generated Participants Can Solve Any Recruitment Problem

Artificial respondents may support methodological preparation, but they cannot automatically replace empirical evidence required to answer questions about actual people.

Misconception

Synthetic Data Are Never Useful Without Real Participants

Simulation studies, software testing, and computational research can be legitimate without recruiting human participants when the research question justifies the design.

Misconception

Matching Empirical Statistics Makes Synthetic Respondents Equivalent

Statistical resemblance does not establish genuine human participation or complete population representativeness.

Misconception

Synthetic Survey Data Can Independently Validate a Questionnaire

Measurement properties calculated from artificial responses reflect the generation process. They do not independently establish how actual participants understand or respond to the instrument.

Misconception

Synthetic Data Are Automatically Safe for Public Release

Generated records derived from sensitive source data may retain information that creates privacy or disclosure risks.

06 · What This Means for You

Distinguish Replacing a Data File From Replacing Empirical Evidence

Researchers should first determine whether the intended task requires actual human observations.

When the purpose is computational or methodological, synthetic data may provide an appropriate substitute for certain data-processing activities.

When the purpose is to understand real human experiences or behavior, artificial records generally cannot provide equivalent evidence.

A simple decision framework

If you need data to test software or analysis code
Use clearly identified synthetic records designed to exercise the relevant functions.
If you need to develop a statistical method
Use appropriate simulation assumptions and interpret findings within the modeled conditions.
If you need to measure actual participant experiences
Collect genuine evidence using an appropriate research design rather than substituting fictional responses.
If you need to share sensitive participant data
Evaluate whether a synthetic dataset provides adequate analytical utility and privacy protection for the intended recipients.
If you are studying AI-generated participants themselves
Frame the research as an investigation of model behavior and avoid unsupported generalization to human populations.

The distinction should also guide decisions about preventing AI-simulated participants from being mistaken for empirical evidence.

Synthetic data may reduce dependence on genuine records for particular tasks, but they do not eliminate the need for empirical validation when the research question requires it.

Watch Out

Do not report AI-generated responses as genuine human participation or interpret artificial observations as independent evidence of actual experiences. A synthetic dataset can support methodological work without establishing that any corresponding participant was recruited or interviewed.

07 · A Quick Checklist

Before Replacing Real Participant Records With Synthetic Data

Verify the following:
Determine whether the research question requires actual human observations or only artificial test data.
Identify the specific task for which synthetic data would substitute for genuine records.
Document the synthetic-data generation method, assumptions, and relevant model information.
Validate the artificial dataset according to its intended methodological application.
Distinguish generated records from actual participant responses throughout storage and analysis.
Avoid counting artificial respondents as additional genuine research participants.
Use appropriate empirical validation when making claims about real populations or prediction performance.
Assess privacy and data-use obligations when synthetic records are derived from sensitive participant information.
Report the artificial origin, analytical role, and limitations of synthetic data accurately.
08 · Frequently Asked Questions

Frequently Asked Questions About Synthetic Data Replacing Human Participants

Can synthetic data replace real participants in research?

Synthetic data can replace real records for certain methodological tasks, but they generally cannot substitute for genuine human participation when a study seeks evidence about actual experiences, attitudes, or behavior.

Can AI-generated survey responses count as actual respondents?

No. Artificial responses do not represent additional human participation and must not be reported as genuine respondent records.

Can synthetic data replace qualitative interviews?

Not as equivalent human testimony. Simulated interviews may support training or methodological testing, but they cannot establish experiences reported by actual participants.

Can synthetic data be used without recruiting any participants?

Yes, for studies whose research questions can appropriately be addressed through simulation, software testing, or other computational methods. The findings must reflect the artificial nature of the evidence.

Can synthetic data validate a questionnaire?

Synthetic records may help test scoring and analytical procedures, but they cannot independently establish how actual respondents understand the items or the instrument's measurement properties in a real population.

Can synthetic data replace sensitive participant records for data sharing?

Potentially, when the generated dataset provides sufficient utility for the intended purpose and disclosure risks have been appropriately evaluated.

Can researchers publish a study based entirely on AI-generated participants?

Potentially, if the research explicitly investigates AI-generated responses or simulation methods. Such findings should not be misrepresented as evidence obtained from actual human participants.

Can synthetic data solve a small-sample problem?

They may support methodological testing or particular model-based analyses, but they cannot create additional independent human observations. Researchers must report the actual empirical sample and its limitations.

09 · The Bottom Line

Synthetic Data Can Replace Some Research Inputs, but Not Human Experience

The Bottom Line

Synthetic data can replace real participant records for certain computational and methodological purposes, but they generally cannot replace genuine human evidence when a study aims to understand actual experiences, attitudes, or behavior. Artificial observations remain outputs of a generation process rather than independent human participation.

Researchers should select synthetic data according to the task, validate their suitability, and report their origin accurately. When scientific claims concern real populations, appropriate empirical evidence remains necessary.

10 · Sources and Further Reading

Authoritative Sources on Synthetic Data and Human Participant Research

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes