Should Qualitative Data Be Used to Explain Quantitative Results in Mixed-Methods Research?

Can Interviews Help Explain What Your Quantitative Results Mean?

Your quantitative analysis is complete. Perhaps an intervention produced a smaller improvement than expected, a statistically significant relationship is difficult to interpret, or two groups with similar characteristics demonstrated unexpectedly different outcomes.

You are considering interviews to understand what happened. But can qualitative data actually explain quantitative results, or would interviews merely provide interesting quotations alongside the statistics?

The distinction matters because qualitative follow-up can strengthen the interpretation of quantitative findings when it investigates a clearly identified explanatory problem. It can also introduce misleading conclusions if researchers treat participants' retrospective accounts as definitive evidence of why a statistical pattern occurred.

The methodological question is not simply whether interviews would be useful. It is what the quantitative findings leave unresolved, what qualitative inquiry could contribute, and how the two forms of evidence will be connected.

Qualitative Data Can Explain Quantitative Findings, but the Explanation Must Be Justified

How Qualitative Evidence Can Help Explain Quantitative Results

What Does It Mean to Explain a Quantitative Finding Qualitatively?

Quantitative analysis can identify patterns, estimate differences, test hypotheses, and examine relationships among measured variables. Depending on the design, it may also support estimates of intervention effects or other causal quantities.

Nevertheless, numerical findings may leave questions about how participants experienced the phenomenon, how particular conditions shaped their behavior, or what processes could account for the observed pattern.

Qualitative inquiry can investigate these unresolved questions through interviews, observations, documents, or other appropriate sources.

For example, a quantitative study might find that students who access a learning management system more frequently tend to obtain higher assessment scores. Interviews could investigate how students use the platform, what activities they undertake, and whether recorded access corresponds with meaningful learning engagement.

The qualitative findings might reveal that students use the same platform features for different purposes. Such evidence could help refine the interpretation of the statistical association.

It would not, by itself, demonstrate that a particular platform activity caused higher assessment scores.

What Kinds of Quantitative Findings Benefit From Qualitative Follow-Up?

Qualitative follow-up is most useful when researchers can identify a specific limitation or unanswered question in the quantitative results.

These examples illustrate possible explanatory purposes rather than guarantees that qualitative inquiry will resolve the uncertainty.

Researchers should avoid treating every unexpected statistical result as a reason to conduct interviews. Sometimes the appropriate response is to examine measurement error, model specification, missing data, sampling limitations, or statistical uncertainty.

How Does Explanatory Sequential Mixed Methods Work?

An explanatory sequential mixed-methods design typically begins with quantitative data collection and analysis. The researcher then uses relevant quantitative findings to guide a qualitative follow-up phase.

Integration commonly occurs when the quantitative results inform qualitative sampling, interview questions, or other data collection decisions. The findings are subsequently brought together during interpretation.

The sequence can be represented conceptually as:

This arrangement is described more fully through the methodological logic of an explanatory sequential mixed-methods design.

However, using qualitative evidence to interpret quantitative findings is not restricted to that design. Concurrent and embedded studies may also integrate qualitative explanations with quantitative outcomes.

Should Every Quantitative Result Receive Qualitative Follow-Up?

No. Attempting to explain every statistical result can make the qualitative component unfocused and analytically unmanageable.

Researchers should prioritize findings that are central to the research question, theoretically important, unexpected, practically consequential, or insufficiently understood through the quantitative evidence alone.

For example, a researcher evaluating an online learning intervention might identify statistically uncertain overall effects but substantial differences in participant engagement. Qualitative follow-up could investigate implementation and engagement experiences if those issues are central to interpreting the intervention.

The selection should be justified rather than based solely on which findings appear interesting after the analysis.

Researchers should also consider the risk of selective follow-up. Investigating only findings that support an anticipated explanation may create a distorted account of the evidence.

How Should Researchers Select Participants for Qualitative Follow-Up?

Participant selection should reflect the quantitative results requiring explanation and the qualitative research purpose.

Researchers may purposively select participants representing contrasting outcomes, unusual cases, particular subgroups, or theoretically relevant patterns.

For instance, a study of digital learning engagement might identify students with similar recorded platform activity but different academic outcomes. Interviewing selected students from these contrasting profiles could help investigate differences in their learning practices.

Another study might focus on participants whose outcomes differ substantially from model-based expectations, provided the researcher considers measurement error and the uncertainty surrounding those expectations.

Participant selection should not be reduced to choosing individuals with the highest and lowest scores without considering whether those cases can meaningfully address the explanatory question.

The procedures for using quantitative results to select interview participants require attention to sampling logic, access, consent, and the intended level of integration.

Should Interview Questions Be Developed From Quantitative Results?

Often, yes. One of the defining opportunities in explanatory sequential research is the ability to design qualitative questions in response to completed quantitative analysis.

Suppose survey findings indicate that teachers report high confidence in using AI-supported assessment tools but relatively limited classroom implementation.

Interviews could investigate how teachers understand confidence, what they consider actual implementation, and which institutional or pedagogical conditions influence their decisions.

These questions are more directly connected to the quantitative results than a generic interview question asking participants to describe their experiences with educational technology.

However, researchers should avoid leading questions that presuppose a particular explanation.

Rather than asking, "Why did institutional restrictions prevent you from using AI?", a more open question might ask, "What factors influenced your decision to use or not use AI-supported assessment tools?"

The latter allows participants to identify influences that the researcher may not have anticipated.

Can Qualitative Data Explain a Statistically Nonsignificant Result?

Qualitative inquiry can investigate experiences or implementation conditions relevant to a statistically nonsignificant finding, but it cannot transform that finding into evidence of an effect.

A nonsignificant result may reflect a small effect, insufficient precision, substantial variability, measurement limitations, or an absence of the hypothesized relationship. Statistical nonsignificance does not establish that the true effect is exactly zero.

Interviews may help investigate whether participants encountered implementation difficulties or experienced the intervention differently. Such findings can inform interpretation and future research.

They cannot establish that an intervention was effective despite an inconclusive quantitative result.

Can Qualitative Findings Establish Why a Statistical Relationship Exists?

Qualitative inquiry can provide evidence about possible processes and participants' interpretations, but the strength of an explanatory claim depends on the broader research design.

Participants may offer plausible accounts of their behavior without accurately identifying every influence on their decisions. Retrospective explanations can be affected by recall limitations, social desirability, and interpretations formed after the event.

Similarly, an interview theme that corresponds with a statistical association does not eliminate confounding or establish temporal order.

Researchers should distinguish between contextual explanation, evidence about a possible mechanism, and a demonstrated causal mechanism.

When the quantitative design supports causal estimation, qualitative evidence may contribute to understanding implementation or mechanisms, but causal interpretations still require appropriate assumptions and supporting evidence.

How Should Quantitative and Qualitative Findings Be Integrated?

Integration should explicitly relate the qualitative findings to the quantitative results they were intended to explain.

One approach is to organize the integrated analysis around selected quantitative findings. For each finding, the researcher identifies relevant qualitative evidence and develops an interpretation that considers both.

A joint display can make this relationship visible.

The examples are hypothetical illustrations of integration logic, not empirical findings.

Joint displays can help researchers compare evidence systematically, but the analytical reasoning remains essential. Simply placing statistical results and interview themes beside each other does not establish a defensible explanation.

What Happens When Qualitative Findings Do Not Explain the Quantitative Results?

Qualitative follow-up does not guarantee a satisfactory explanation. Interviews may produce accounts that do not correspond with the expected patterns, or participants may identify influences that were not represented in the quantitative model.

Such outcomes should not automatically be treated as methodological failure.

The researcher may need to reconsider whether the samples are appropriately connected, whether the measures represent the intended constructs, or whether the proposed explanation was too narrow.

In some cases, the qualitative findings may challenge the original interpretation rather than clarify it.

Researchers should examine disagreements between quantitative and qualitative findings rather than forcing the evidence into a coherent narrative.

Can Qualitative Explanation Be Used in Concurrent Mixed Methods?

Yes. Qualitative findings collected concurrently with quantitative data may help interpret statistical results during the integration stage.

However, because the qualitative component was not necessarily designed in response to completed quantitative findings, it may not address the most unexpected or consequential statistical patterns directly.

Researchers can reduce this limitation by anticipating relevant explanatory questions and coordinating the components during study design.

If the principal purpose requires targeted follow-up based on specific quantitative results, a sequential arrangement may provide a stronger methodological fit.

How Can Researchers Avoid Two Parallel Analyses?

A study may collect quantitative and qualitative data rigorously yet fail to establish meaningful integration.

For example, a researcher might report statistical findings in one chapter and interview themes in another without explaining how the themes relate to the numerical results.

To avoid this problem, researchers should identify the quantitative findings selected for follow-up, document how those findings informed qualitative sampling or questions, and explain the resulting integrated interpretations.

The methodological concern is not the physical separation of results sections. It is whether the components make a connected contribution to the overarching research problem.

This distinction helps researchers avoid conducting two separate studies under a mixed-methods label.

Using Interviews to Investigate Unexpected Survey Findings

Suppose interviews suggest that some teachers interpret confidence as the ability to operate AI tools, while their implementation decisions depend on assessment validity, institutional guidance, and professional responsibilities.

An integrated interpretation might suggest that technical confidence and willingness to implement AI-supported assessment represent different aspects of professional practice.

This would be a more informative conclusion than simply stating that teachers were confident but did not use AI frequently.

Nevertheless, the interview findings would not establish that institutional uncertainty caused the observed implementation pattern. Additional evidence would be needed to support stronger causal claims.

Common Mistakes When Using Qualitative Data to Explain Quantitative Results

How to Decide Whether Qualitative Follow-Up Is Worth Conducting

Begin by examining what the quantitative analysis actually establishes. Identify findings whose interpretation remains incomplete and determine whether qualitative inquiry could address the unresolved questions.

Do not assume that every statistical uncertainty requires interviews. Some problems are better addressed through additional quantitative analysis, improved measurement, sensitivity analysis, or more appropriate study design.

Before collecting qualitative data, document which quantitative findings will guide the follow-up, how participants or evidence sources will be selected, and what questions the qualitative component will investigate.

During analysis, preserve the distinction between what the quantitative evidence establishes and what the qualitative evidence suggests. The integrated conclusion should reflect both contributions without overstating either.

Check Whether Your Qualitative Follow-Up Can Explain the Quantitative Findings

Frequently Asked Questions About Qualitative Explanations of Quantitative Results

Use Qualitative Evidence to Investigate What the Numbers Leave Unresolved

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.