03 · What You Need to Know
What Causal Inference Requires Beyond a Cross-Sectional Association
What Is a Causal Claim?
A causal claim concerns how an outcome would differ if an exposure or intervention were changed, compared with what would occur under an alternative condition.
For example, the statement "Teachers who completed AI literacy training had higher competency scores" describes an observed association.
The statement "AI literacy training increased teachers' competency scores" asserts that training caused a difference in the outcome.
The second statement requires evidence about the effect of training, not merely evidence that trained and untrained teachers differ.
Causal inference frameworks commonly express this distinction through potential outcomes. For each unit, one can conceptually define an outcome under one intervention condition and an outcome under an alternative condition.
The fundamental challenge is that the same unit cannot ordinarily be observed under both alternative conditions at the same moment.
A research design must therefore provide a defensible strategy for estimating the relevant counterfactual comparison.
Why Association Is Not the Same as Causation
Two characteristics may be statistically associated for several reasons.
One may influence the other. The reverse direction may operate. Both may be influenced by a common cause. Selection processes or measurement problems may also produce an observed relationship.
Suppose teachers with higher AI literacy use generative AI more frequently.
Higher literacy might encourage use. Frequent use might contribute to literacy. Teachers with greater prior interest in technology might both develop literacy and use AI more often.
A cross-sectional association does not independently distinguish these possibilities.
The study can establish the observed relationship between measured characteristics without establishing which causal explanation, if any, is correct.
What Role Does Temporality Play in Causal Inference?
For a cause to produce an effect, the relevant causal exposure must precede the effect in the proposed causal sequence.
When exposure and outcome are measured during the same survey, this sequence may be unknown.
For example, a cross-sectional study of AI literacy and AI use may not establish whether literacy developed before frequent usage.
However, the date of data collection should not be confused with the date when an exposure occurred.
A survey administered once may collect reliable records showing that a training program was completed two years before the current competency assessment.
Such information can establish that training preceded the measured outcome. It does not establish that training caused the outcome, because participants may have differed before training or experienced other relevant events afterward.
The central distinction is between establishing temporal order in cross-sectional research and identifying a causal effect.
Why Reverse Causation Is a Particular Concern
Reverse causation occurs when the presumed outcome influences the presumed exposure.
Suppose researchers hypothesize that AI literacy increases the frequency of AI use. The observed association may instead arise because repeated AI use helps students develop literacy.
Both processes could also operate simultaneously over time.
Cross-sectional measurements of current literacy and current usage may be unable to distinguish these possibilities.
Statistical adjustment does not automatically solve reverse causation. Including academic level, age, or institutional characteristics in a regression model cannot reconstruct an unobserved temporal sequence.
When causal direction is central to the research question, longitudinal measurements or other reliable temporal evidence may be necessary.
What Is Confounding, and Why Does It Matter?
Confounding occurs when the association between an exposure and outcome does not identify the intended causal effect because other relevant causal factors influence their relationship.
For example, teachers with greater prior technology experience may be more likely to enroll in AI literacy training and may also perform better on a later competency assessment.
If prior experience is not adequately addressed, the difference between trained and untrained teachers may partly reflect preexisting characteristics rather than the effect of training.
Measured confounders can sometimes be addressed through restriction, stratification, matching, weighting, regression adjustment, or other appropriate methods.
However, these procedures depend on assumptions about which variables are confounders, whether they are measured adequately, and whether sufficient comparable observations are available.
Unmeasured confounding may remain. Adjustment for inappropriate variables can also introduce bias.
A causal interpretation therefore requires substantive reasoning about the processes generating the exposure and outcome, not simply a regression model containing many covariates.
Why Does a Causal Question Need a Clearly Defined Intervention?
Causal questions become more precise when researchers specify the exposure or intervention conditions being compared.
For example, "Does AI literacy affect academic performance?" is ambiguous because AI literacy is a complex characteristic that may change through different experiences.
A more clearly defined causal question might ask whether assigning teachers to a specified AI literacy training program, compared with not assigning them to that program, changes competency scores after a defined follow-up period.
The intervention, comparison condition, outcome, population, and time horizon are now explicit.
Not every causal question concerns an intervention that can be implemented straightforwardly. Some exposures are not directly manipulable, and causal inference for them requires careful definition of the hypothetical contrast and its interpretation.
The key point is that a vague association between characteristics should not be mistaken for a well-defined causal effect.
What Is a Causal Estimand?
A causal estimand is the specific causal quantity a study intends to estimate.
For example, researchers may seek the average difference in competency scores that would occur if all eligible teachers received a defined training program rather than none receiving it.
Using potential-outcomes notation, this can be expressed as an average treatment effect.
The formula clarifies why causal inference is demanding. The researcher must identify the relevant counterfactual contrast from observed data under a defensible set of assumptions.
Merely comparing current trained and untrained respondents does not guarantee that the observed group means estimate the potential-outcome means.
What Assumptions Are Needed to Identify a Causal Effect?
The required assumptions depend on the causal question and identification strategy. In potential-outcomes analyses, several concepts are particularly important.
| Concept |
Meaning |
Why it matters |
| Consistency |
The observed outcome corresponds to the potential outcome under the exposure condition actually received, with intervention versions appropriately defined. |
Connects observed outcomes to the specified causal contrast. |
| Exchangeability |
Exposure groups are comparable with respect to relevant potential outcomes, possibly conditional on measured covariates. |
Addresses confounding in the intended comparison. |
| Positivity |
Relevant exposure conditions have positive probability within the covariate patterns needed for the target comparison. |
Ensures the data contain support for the required comparisons. |
| Appropriate measurement |
Exposure, outcome, and relevant covariates are measured with sufficient validity for the analysis. |
Limits bias from misclassification and measurement error. |
| Selection assumptions |
Inclusion, retention, or conditioning processes do not introduce uncontrolled bias into the causal comparison. |
Protects the identification strategy from selection-related distortion. |
These concepts do not constitute a universal checklist that guarantees causal identification. Their precise formulations and sufficiency depend on the design and estimand.
Some assumptions cannot be verified directly from the observed dataset. Researchers must justify them through design features, substantive knowledge, and sensitivity analysis where appropriate.
Can Regression Adjustment Make Cross-Sectional Data Causal?
Not automatically. Regression adjustment can estimate associations conditional on selected covariates, but a causal interpretation requires more than including those covariates in a model.
Suppose researchers estimate the relationship between previous AI literacy training and current competency while adjusting for age, academic rank, and teaching experience.
The adjusted coefficient may describe a conditional association. It does not necessarily represent the training effect if relevant baseline competency, prior motivation, or institutional opportunities remain unmeasured.
Moreover, adjusting for variables affected by the exposure may change the causal estimand or introduce bias under particular causal structures.
Researchers should use a conceptual causal model to justify which variables require adjustment and why.
The statistical model is part of the analysis, not a substitute for the identification strategy.
Can Propensity Score Methods Establish Causation?
Propensity score methods can support causal analyses of observational data by addressing measured differences in exposure assignment under specified assumptions.
For example, researchers may estimate the probability of participating in AI literacy training based on relevant pretraining characteristics and use that information for matching or weighting.
However, propensity score methods do not automatically address unmeasured confounding, reverse causation, or inaccurate historical information.
The covariates used should be appropriate for the causal question, particularly regarding their temporal relationship to the exposure.
Balance on measured covariates is useful but does not demonstrate that all relevant potential outcomes are exchangeable.
Cross-sectional data lacking suitable pre-exposure information may therefore remain inadequate for a credible causal analysis even after propensity score adjustment.
Can a Cross-Sectional Dataset Contain Enough Historical Information for Causal Analysis?
Potentially. The term cross-sectional usually describes when the main observations were collected, but a dataset may contain information about earlier exposures, institutional assignments, or historical events.
For example, a one-time competency assessment could be linked to reliable records of a training program that was randomly assigned before the assessment.
In that situation, the randomized assignment and follow-up outcome measurement may support causal inference, even though the outcome is assessed at one later occasion.
However, the overall research design would be better characterized by its randomized intervention structure rather than treated as an ordinary observational cross-sectional survey.
Similarly, a retrospective observational dataset may contain exposure histories sufficient for a particular causal strategy, but its validity depends on the quality of those histories and the identification assumptions.
This distinction prevents the misleading conclusion that one-time outcome measurement automatically rules out causal inference.
Why Are Selection Bias and Collider Bias Relevant?
Selection bias can arise when inclusion in the analyzed sample depends on factors related to both the exposure and outcome.
For example, a survey restricted to students who remain enrolled may exclude individuals whose earlier educational experiences affected their likelihood of withdrawal.
If enrollment status is influenced by both an exposure and an outcome-related factor, conditioning on continued enrollment can distort their observed relationship.
Collider bias is one possible mechanism. It occurs when conditioning on a common effect of two variables creates or distorts an association between them.
Such bias can arise through sample selection, statistical adjustment, or restrictions on the analyzed population.
Researchers should therefore consider how the observed sample was formed and whether inclusion or adjustment decisions affect the causal relationship under investigation.
Can Cross-Sectional Mediation Analysis Establish a Causal Mechanism?
Cross-sectional mediation models may estimate statistical indirect associations, but these should not automatically be interpreted as causal mechanisms.
Suppose researchers propose that AI literacy influences academic engagement through confidence in using AI tools.
A mediation model estimated from all three variables measured during one survey may fit the data, but that fit does not establish the temporal or causal sequence.
Alternative structures, including reverse pathways and common causes, may be compatible with the observed associations.
Causal mediation requires additional assumptions concerning exposure, mediator, outcome, confounding, and the relevant counterfactual contrasts.
Longitudinal measurement can provide useful temporal information, although it does not by itself guarantee causal identification.
The methodological question is whether the design supports the proposed mechanism, not merely whether an indirect coefficient is statistically significant.
When Would a Longitudinal or Experimental Design Be Preferable?
When the central question concerns the effect of an intervention, random assignment may provide a particularly strong basis for causal inference when feasible and ethically appropriate.
Where randomization is impractical, quasi-experimental approaches may be considered, including designs using credible comparison groups, policy discontinuities, instrumental variables, or interrupted time series under appropriate assumptions.
Longitudinal observational studies can improve temporal information by measuring exposures before subsequent outcomes and documenting changes over time.
However, longitudinal follow-up does not automatically eliminate confounding or selection bias.
The choice between experimental and observational designs should depend on the causal question, feasibility, ethical considerations, and the assumptions required for identification.
A more elaborate design is not inherently stronger if its implementation or assumptions are poorly matched to the research question.
What If a Causal Design Is Not Feasible?
Researchers should not manufacture causal certainty when the available evidence cannot support it.
A cross-sectional study may still provide useful evidence about prevalence, group differences, and associations.
For example, identifying a substantial association between institutional support and teachers' AI literacy may justify further investigation or inform the development of an evaluation.
The appropriate conclusion would describe the observed relationship and acknowledge unresolved explanations.
Researchers may also revise the original causal question into a defensible descriptive or associational question when methodological constraints prevent credible causal inference.
The distinction between methodological compromise and a change in the research question matters because a weaker design may no longer answer the original causal question.
How Should Causal Language Be Used in Reporting?
Researchers should choose wording that reflects the actual inferential basis of the study.
| Potentially unsupported causal claim |
More defensible associational statement |
| AI literacy training improved teachers' competency. |
Teachers reporting previous AI literacy training had higher observed competency scores. |
| Frequent AI use increased students' academic confidence. |
Frequent AI use was associated with higher reported academic confidence. |
| Institutional support caused greater AI adoption. |
Higher reported institutional support was associated with more frequent AI adoption. |
| AI literacy explains why students use AI more often. |
AI literacy scores were associated with AI usage frequency in the observed data. |
These revisions are appropriate when the study has not identified a causal effect.
If a credible causal identification strategy has been implemented, causal language may be warranted, but the report should explain the estimand, design, assumptions, sensitivity analyses, and limitations supporting that interpretation.
Adding cautious words such as "may" does not independently justify an otherwise unsupported causal claim.
Watch Out
Do not interpret a statistically significant regression coefficient, a well-fitting structural equation model, or a propensity-score-adjusted association as automatically causal. Causal inference depends on the identification strategy and its assumptions, not on the sophistication of the statistical procedure.