03 · What You Need to Know
How AI Can Support Conceptual Synthesis Across Research Studies
What Is Conceptual Synthesis?
Conceptual synthesis involves integrating concepts, theoretical propositions, and relevant empirical findings to develop a coherent understanding of a research problem.
Rather than simply identifying what studies found, it examines how the ideas underlying those findings relate to one another. This may involve clarifying constructs, comparing theoretical assumptions, identifying conceptual tensions, or developing an interpretation that connects evidence from different research traditions.
For example, studies of generative AI in education may examine perceived usefulness, trust, AI literacy, critical evaluation, and reliance on generated information. A conceptual synthesis could investigate how these constructs have been defined and whether the literature supports relationships among them.
The objective is not necessarily to create a new theory. It may instead clarify an existing conceptual relationship, reconcile different uses of terminology, or identify assumptions that require further investigation.
Empirical synthesis
Integrates evidence about observed findings, outcomes, experiences, or relationships across studies.
Conceptual synthesis
Integrates concepts and theoretical interpretations to clarify how ideas relate and what the literature supports or leaves unresolved.
These activities can overlap. Empirical findings may inform conceptual development, while theoretical concepts shape how evidence is interpreted.
How Does Conceptual Synthesis Differ From Organizing Papers Into Themes?
Thematic organization groups studies around recurring topics or analytical issues. Conceptual synthesis goes further by examining relationships among the ideas represented within and across those themes.
For example, a thematic review might contain separate sections on AI literacy, trust in AI, and students' verification practices.
A conceptual synthesis would ask whether the literature supports relationships among these constructs, how the constructs have been operationalized, and whether different theoretical perspectives explain their connections.
AI may assist with both activities, but organizing research papers into themes does not automatically establish a conceptual framework.
What Information Does AI Need for Conceptual Synthesis?
A conceptual synthesis requires more than a list of study findings. Researchers should provide information about the concepts investigated, how those concepts were defined, the theoretical perspectives used, the relationships proposed or tested, and the limitations of the evidence.
For empirical studies, it is important to distinguish relationships that were directly examined from those merely discussed in the introduction or proposed as explanations.
For theoretical papers, researchers should identify the authors' propositions and underlying assumptions without presenting them as empirically demonstrated findings.
Useful records may include the following:
| Information |
What to record |
Why it matters |
| Concept or construct |
The central idea investigated or proposed. |
Establishes the conceptual units being integrated. |
| Definition |
How the authors define the construct. |
Reveals differences concealed by shared terminology. |
| Theoretical perspective |
The framework or assumptions informing the study. |
Clarifies why relationships are expected. |
| Proposed relationship |
The association or mechanism suggested by the authors. |
Distinguishes theoretical propositions from observations. |
| Empirical evidence |
What was actually measured, observed, or analyzed. |
Establishes the evidential support available. |
| Limitations |
Constraints affecting interpretation. |
Prevents unsupported generalization. |
These records can be organized using a literature review matrix adapted to conceptual rather than purely methodological comparison.
Why Conceptual Definitions Must Be Compared Before Relationships
Two studies may use the same term while referring to different constructs. Conversely, studies may use different terminology for ideas that substantially overlap.
Consider the concept of trust in AI. One study might define trust as confidence in the accuracy of generated information. Another may define it as willingness to rely on AI recommendations. A third might investigate perceived credibility.
These constructs may be related, but they are not automatically interchangeable.
AI can identify similarities in their descriptions, yet the researcher must examine whether combining them would preserve or distort their meanings.
Conceptual synthesis should therefore begin with construct clarification. Without it, a model may create relationships between concepts whose definitions are inconsistent across studies.
Can AI Connect Concepts That Were Studied Separately?
AI can propose relationships among concepts that appear in different studies. This can be useful for developing hypotheses or identifying questions that have not been directly investigated.
Suppose one study examines AI literacy and verification practices, while another investigates trust and reliance on AI-generated information. AI might propose that AI literacy influences reliance through verification behavior.
That proposition may be theoretically plausible. However, the two studies do not necessarily establish the complete relationship, particularly if they involve different populations, measures, or contexts.
The researcher should distinguish relationships directly supported by evidence from connections inferred across separate studies.
Evidence-supported relationship
A relationship directly examined or otherwise adequately supported by the available studies, with its inferential limitations acknowledged.
Proposed conceptual relationship
A plausible connection suggested by integrating existing ideas but not yet adequately established by the evidence.
Both may contribute to scholarly reasoning, provided their evidential status remains explicit.
Why AI Can Invent Plausible Theoretical Mechanisms
Generative AI is capable of producing coherent explanations linking concepts through proposed mediators, moderators, or causal pathways.
For example, it might suggest that AI literacy improves critical thinking because it increases verification behavior, which subsequently reduces uncritical reliance on AI-generated information.
This sequence is conceptually plausible, but each relationship requires justification. Studies showing associations among selected constructs do not necessarily establish the complete causal pathway.
A model may also use terms such as mediation and moderation without sufficient methodological support.
Watch Out
A conceptual diagram containing arrows does not establish causal relationships. Directional arrows, mediating pathways, and moderating effects should reflect explicit theoretical propositions or appropriate empirical evidence. Where support is incomplete, identify the connections as hypotheses rather than established mechanisms.
Can AI Combine Different Theoretical Perspectives?
AI can help compare theoretical frameworks and identify concepts that appear compatible or potentially complementary.
For example, a review of educational technology adoption might draw on theories addressing perceived usefulness, self-efficacy, and social influences. AI may suggest how these perspectives could inform a broader conceptual interpretation.
However, theoretical integration requires examining the assumptions underlying each framework. Concepts developed for different explanatory purposes should not be combined simply because their labels appear related.
Researchers should ask whether the theories operate at compatible levels of analysis, whether their assumptions conflict, and whether the proposed integration adds explanatory value.
A synthesis that merely places concepts from several theories into one diagram may increase complexity without improving understanding.
How Can AI Help Identify Conceptual Tensions?
Conceptual synthesis is not limited to finding common ground. It may also reveal disagreements about definitions, mechanisms, or theoretical assumptions.
For instance, one research tradition may conceptualize AI reliance as a consequence of perceived usefulness, while another emphasizes epistemic trust and the evaluation of information credibility.
These perspectives need not be mutually exclusive, but they may explain different aspects of the phenomenon.
AI can help articulate such differences when supplied with accurate theoretical descriptions. The researcher should then determine whether the apparent tension is genuine or results from differences in terminology or analytical focus.
This requires careful attention to agreement and disagreement across the literature, including disagreements that concern theoretical interpretation rather than empirical outcomes.
Does Conceptual Synthesis Require a New Conceptual Framework?
No. A conceptual synthesis may result in a clarified definition, an integrated interpretation, a set of propositions, or a more precise account of how existing theories relate.
A visual conceptual framework can be useful when the relationships are sufficiently developed, but it is not a necessary product of every synthesis.
Where a framework is proposed, researchers should explain the meaning of each construct and relationship, the evidence supporting it, and the assumptions that remain untested.
Conceptual development should serve the research problem rather than the desire to produce an elaborate diagram.
How Can Researchers Verify an AI-Generated Conceptual Synthesis?
Verification should operate at the level of individual conceptual claims.
For each proposed relationship, identify the supporting studies and determine whether the evidence is theoretical, observational, experimental, qualitative, or otherwise interpretive.
Check whether the studies use compatible definitions and whether their designs support the proposed direction or mechanism.
When AI introduces a connection not directly examined in the literature, record it as an interpretive proposal and explain the reasoning behind it.
Maintaining traceability between conceptual claims and their supporting studies makes it easier to distinguish evidence from speculation.
This is particularly important when the synthesis will inform a research framework, hypothesis, intervention design, or policy recommendation.
04 · A Practical Example
Developing a Conceptual Synthesis of AI Literacy, Trust, and Verification
Hypothetical Example
Connecting Findings Without Inventing a Causal Model
A researcher examines four hypothetical studies concerning how university students evaluate and rely on AI-generated information. The studies address related constructs but do not investigate the same complete relationship.
| Study |
Concepts examined |
Illustrative finding |
| A |
AI literacy and verification performance |
Higher AI literacy scores were associated with better performance on verification tasks. |
| B |
Trust and reliance |
Greater reported trust in AI was associated with more frequent reliance on generated recommendations. |
| C |
Verification practices and AI use |
Interview participants described checking AI-generated information when they perceived uncertainty. |
| D |
AI literacy instruction |
Students receiving evaluation guidance demonstrated improved performance on source-checking tasks. |
All studies and findings are hypothetical.
What Conceptual Relationships Are Actually Supported?
Step 1: Identify the constructs
The literature examines AI literacy, verification performance, trust, reliance, and evaluation guidance. The researcher checks how each construct is defined and measured.
Step 2: Map directly examined relationships
Study A reports an association between literacy and verification performance. Study B reports an association between trust and reliance. Study D examines the effect of evaluation guidance on source-checking performance.
Step 3: Identify interpretive connections
Study C suggests that perceived uncertainty may be relevant to verification practices. However, the collection does not establish a complete pathway connecting AI literacy, trust, verification, and reliance.
Step 4: Develop a qualified conceptual synthesis
Integrate the findings while distinguishing demonstrated relationships from propositions that require additional investigation.
An Overstated AI-Generated Conceptual Model
"AI literacy increases verification behavior, which reduces trust in inaccurate AI-generated information and consequently prevents excessive reliance on AI. Verification therefore mediates the relationship between AI literacy and AI dependence."
This model introduces a causal sequence and a mediating relationship that the hypothetical studies did not establish. The studies examined selected associations and outcomes, but none tested the complete pathway.
A More Defensible Conceptual Synthesis
"The hypothetical studies suggest that AI literacy, verification practices, and trust represent related but distinct dimensions of students' engagement with AI-generated information. Study A identifies an association between AI literacy and verification performance, while Study D provides experimental evidence that evaluation guidance can improve source-checking performance under the conditions examined. Study B associates trust with reliance on AI recommendations, and Study C offers qualitative insight into how perceived uncertainty may influence verification practices. Together, these findings suggest possible conceptual connections among evaluative competence, trust, and reliance. However, the available evidence does not establish a complete causal pathway or demonstrate that verification mediates the relationship between literacy and reliance."
The revised synthesis integrates the concepts without assigning causal relationships that the studies did not investigate.
It also identifies a possible question for future research: whether verification practices help explain the relationship between AI literacy and reliance. That proposition would require further theoretical justification and appropriate empirical investigation before being treated as established.