Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

When Is Qualitative Evidence Synthesis the Best Way to Answer the Review Question?

Qualitative evidence synthesis is most useful when the review question requires understanding experiences, perspectives, meanings, behaviors, implementation, or context rather than estimating how much an intervention works. The key is matching the synthesis to the kind of answer the question requires.

710
When Is Qualitative Evidence Synthesis Appropriate? Guide 710 of 899
01 · The Question

Does Your Review Need to Know What Happens, or Understand Why and How?

Some review questions are fundamentally quantitative. How effective is an intervention? How common is a condition? Is one approach associated with better outcomes than another? These questions usually require evidence expressed through quantities, comparisons, or estimates.

Other questions require a different kind of evidence. How do students experience AI-assisted feedback? Why do clinicians resist an intervention despite evidence that it works? What makes a program acceptable to some groups but not others? How does organizational context influence implementation?

Individual qualitative studies can illuminate these questions. When relevant qualitative research has accumulated across settings, populations, or studies, however, reading a few illustrative papers is not the same as systematically examining what that body of evidence collectively suggests.

That is where qualitative evidence synthesis can become particularly useful.

02 · The Short Answer

Use Qualitative Evidence Synthesis When Understanding Is the Evidence You Need

In Brief

Qualitative evidence synthesis is particularly appropriate when your review question requires systematically integrating qualitative evidence about people's experiences, perspectives, beliefs, meanings, behaviors, implementation processes, or the influence of context rather than primarily estimating the magnitude or frequency of an outcome.

It can stand alone or complement an intervention review. The important distinction is not simply whether qualitative studies exist, but whether qualitative evidence provides the kind of answer needed for the research or decision problem.

03 · What You Need to Know

Qualitative Evidence Synthesis Answers Questions That Numbers Alone Cannot Resolve

Qualitative evidence synthesis systematically integrates qualitative evidence

Qualitative evidence synthesis, commonly abbreviated QES, refers to systematic approaches for identifying, appraising, and synthesizing qualitative evidence. Cochrane describes QES methodologies as approaches to the systematic review of qualitative research evidence, either as standalone reviews or as part of reviews of complex interventions, systems, or guideline development.

JBI similarly provides methodology for systematic reviews of qualitative evidence, while emphasizing its own meta-aggregative approach. Importantly, qualitative evidence synthesis is not one single method. Different synthesis traditions have different philosophical assumptions, purposes, analytical procedures, and intended outputs.

This means that deciding to conduct a QES is only the first methodological decision. You must subsequently determine which synthesis approach fits the question and the nature of the available qualitative evidence.

Experiences and perspectives are natural QES questions

One of the clearest reasons to conduct a QES is that the review question concerns how people experience or perceive a phenomenon.

You might want to understand patients' experiences of telemedicine, teachers' perceptions of generative AI, caregivers' experiences of supporting relatives with dementia, or students' perceptions of online assessment. These are not merely outcomes waiting to be converted into percentages. They involve meanings, interpretations, expectations, relationships, and context.

Cochrane identifies understanding people's values, attitudes, experiences, and perspectives as an important contribution of qualitative evidence to decision making. Its qualitative evidence guidance includes questions such as what it is like to experience a condition or situation and how people behave when receiving an intervention.

A QES can bring findings from multiple qualitative studies together to identify recurring patterns, differences, explanations, or higher-order interpretations that may not be apparent from any single study.

QES can explain why an intervention works differently across contexts

An effectiveness review might indicate that an intervention produces different results across studies. The numbers can establish that variation exists without necessarily explaining it.

Qualitative evidence may help reveal differences in implementation, organizational culture, participant expectations, professional relationships, accessibility, acceptability, resources, or local practices. Cochrane specifically notes that QES can improve understanding of intervention complexity, contextual variation, implementation, and the influence of individual and contextual characteristics.

This makes qualitative evidence particularly useful when the practical question is not simply “Does it work?” but “How does it work, for whom, under what circumstances, and what affects whether people actually use it?”

Effectiveness question Does the intervention improve the specified outcome, and by how much?
Qualitative question How do people experience the intervention, what influences its implementation or acceptability, and how does context shape what happens?

These questions are complementary rather than competitors. In many real decisions, knowing one without the other leaves an important part of the problem unanswered.

An intervention can work and still be difficult to implement

Suppose randomized trials suggest that a new educational intervention improves learning outcomes. That evidence does not establish whether teachers consider the intervention feasible, whether students find it acceptable, why implementation varies between institutions, or what barriers prevent sustained adoption.

A QES may therefore accompany an intervention review. Cochrane explicitly recognizes qualitative evidence syntheses conducted alongside intervention reviews or integrated within mixed-method review designs.

The quantitative synthesis may estimate effects. The qualitative synthesis may help explain implementation, acceptability, experiences, and context. Neither automatically substitutes for the other.

Barriers and facilitators are common QES targets, but they need a clear phenomenon

Many qualitative syntheses investigate barriers and facilitators. This can be useful when a decision depends on why people adopt, reject, implement, modify, or discontinue an intervention or practice.

However, “What are the barriers and facilitators?” can become a rather generic review question if the population, phenomenon, and context remain vague. Barriers to what behavior? Experienced by whom? In what setting? At what stage of implementation?

Cochrane's guidance emphasizes careful specification of context during QES question development because context affects evidence interpretation and subsequent assessment of confidence in synthesis findings.

JBI similarly structures qualitative review eligibility around participants, phenomena of interest, context, and types of studies. The review question should therefore make clear what human experience or phenomenon the synthesis is actually trying to understand.

QES is useful when meaning differs across groups or settings

A phenomenon may carry different meanings across cultures, professions, institutions, communities, or social groups. Aggregating these differences into a single numerical outcome can sometimes obscure precisely what matters.

A qualitative synthesis can examine commonalities while preserving contextual variation. It may reveal that a practice regarded as convenient in one setting is experienced as burdensome elsewhere, or that apparently similar behaviors arise for different reasons.

This contextual sensitivity is particularly valuable when transferring interventions or policies from one setting to another. Evidence that something was acceptable somewhere does not establish that it will be acceptable everywhere.

QES can contribute to policy and guideline decisions

Decision makers rarely need effectiveness evidence alone. They may also need to consider acceptability, feasibility, values, preferences, equity, and implementation.

Qualitative evidence syntheses have consequently been used in guideline and policy development to inform these dimensions. The value lies in systematically bringing stakeholder perspectives and contextual evidence into decisions that might otherwise rely predominantly on quantitative outcomes.

This does not mean qualitative findings automatically dictate what policy should be adopted. They provide another evidence stream that can illuminate consequences, concerns, experiences, and implementation conditions relevant to the decision.

QES is not simply a narrative review containing qualitative studies

A narrative review may discuss qualitative research, but QES normally involves explicit systematic procedures for identifying and synthesizing qualitative evidence.

The distinction matters because a QES makes claims about a systematically assembled body of qualitative evidence rather than selecting individual studies primarily to support a scholarly narrative. If your purpose is broad conceptual or historical interpretation across diverse literature, a narrative review may be more appropriate.

If the purpose is to systematically synthesize findings from qualitative studies addressing an answerable question, QES becomes a stronger candidate.

Qualitative evidence synthesis is broader than one specific method

Researchers sometimes use terms such as qualitative evidence synthesis, qualitative systematic review, meta-synthesis, thematic synthesis, meta-ethnography, and meta-aggregation as though they were interchangeable. They are not necessarily equivalent.

QES is a broad category encompassing multiple synthesis methodologies. JBI's guidance, for example, focuses on meta-aggregation, while other approaches may aim for more interpretive or theory-generating synthesis.

The difference between meta-synthesis and meta-analysis is particularly important because qualitative synthesis is not a qualitative version of statistically pooling effect estimates.

Your choice of synthesis method should reflect the review question, the intended output, the available evidence, and the methodological assumptions of the approach.

Not every question containing the word “why” requires QES

Question wording alone does not determine evidence type. Some explanatory questions may require quantitative mediation analyses, causal inference, process evaluations, mixed-method evidence, or other approaches.

Likewise, qualitative evidence can sometimes contribute to questions that do not explicitly ask “why” or “how.” A review of people's preferences, for example, may be fundamentally qualitative even if the question is phrased differently.

The better test is to ask what kind of primary evidence could genuinely answer the question. If the answer requires participants' accounts, interpretations, experiences, behaviors, or contextual explanations, qualitative evidence is likely to be central.

The available qualitative evidence must be rich enough to support synthesis

Cochrane distinguishes between qualitative evidence with greater or lesser conceptual richness and contextual detail. A QES can encounter studies that provide rich interpretive findings alongside studies offering relatively thin descriptions.

The existence of several papers labeled “qualitative” does not guarantee that they contain sufficient data or findings for the synthesis you intend to conduct. Review teams should examine what qualitative material is actually available and whether it can support the planned level of interpretation.

Watch Out

Do not choose qualitative evidence synthesis merely because your search finds interview or focus-group studies. First establish that the review question requires qualitative understanding and that the available studies contain findings capable of contributing to that synthesis.

Confidence in qualitative synthesis findings can be assessed systematically

Qualitative synthesis does not mean that every resulting theme or finding should be accepted with equal confidence. GRADE-CERQual provides a structured approach for assessing confidence in individual findings from qualitative evidence syntheses.

CERQual considers methodological limitations of contributing studies, coherence of the review finding, adequacy of the supporting data, and relevance of those data to the review question. The resulting assessment communicates how much confidence users may place in a synthesis finding.

This is particularly useful when QES findings are intended to inform guidelines, policy, or other decisions. A compelling theme supported by thin, indirect, or methodologically limited evidence should not be presented with the same confidence as a well-supported finding.

04 · A Practical Example

When “Does It Work?” Is Only Half of the Review Question

Hypothetical Example

AI-supported feedback in higher education

Suppose several studies have evaluated AI systems that provide automated formative feedback to university students. A research team initially wants to know whether these systems improve learning outcomes, but institutions considering adoption are also concerned about whether students trust the feedback, how teachers integrate it into their courses, and what makes students accept or ignore AI-generated suggestions.

Effectiveness question Do AI-supported feedback systems improve specified student learning outcomes compared with the relevant alternative?
Qualitative question How do students and instructors experience AI-supported feedback, and what factors influence its trust, acceptability, use, and implementation?
Evidence choice Quantitative effectiveness studies are appropriate for the first question. Qualitative studies containing participants' experiences and perspectives provide evidence for the second.
Synthesis decision If sufficient relevant qualitative studies exist, a QES can systematically integrate those findings. The researchers may conduct it independently or connect it with an effectiveness review through an appropriate mixed-method design.

A meta-analysis showing a positive average effect would not answer whether students trust the feedback. A collection of interview studies would not, by itself, estimate the intervention's average effect. The best synthesis depends on which uncertainty the review is actually intended to reduce.

05 · What Researchers Often Get Wrong

Common Mistakes When Choosing Qualitative Evidence Synthesis

Misconception

Qualitative Evidence Synthesis Is What You Use When Meta-Analysis Is Impossible

No. Failure to statistically pool quantitative studies does not turn them into qualitative evidence. A systematic review of quantitative studies may use other synthesis methods when meta-analysis is inappropriate. QES addresses questions requiring qualitative evidence and synthesizes qualitative findings or data.

Misconception

QES Is Mainly for Summarizing Interview Quotes

Qualitative synthesis goes beyond assembling illustrative quotations. Depending on the methodology, reviewers systematically synthesize findings, concepts, categories, themes, explanations, or interpretations across studies to produce a higher-level understanding of the phenomenon.

Misconception

If the Intervention Works, Qualitative Evidence Is Unnecessary

Effectiveness does not establish acceptability, feasibility, implementation, or how people experience an intervention. These issues may determine whether an intervention that works under study conditions succeeds in practice.

Misconception

All Qualitative Synthesis Methods Produce the Same Kind of Answer

Different approaches can have different philosophical foundations and analytical aims. Some are more aggregative and oriented toward actionable findings, while others are more interpretive or theory-generating. Method selection should follow the question and intended synthesis rather than familiarity alone.

Misconception

QES Is Less Systematic Because the Evidence Is Qualitative

Qualitative evidence syntheses can use explicit protocols, eligibility criteria, systematic searches, critical appraisal, structured synthesis methods, and transparent reporting. The evidence and analytical logic differ from quantitative synthesis; systematic methodology is not abandoned.

Misconception

Every Qualitative Study on the Topic Should Be Combined

Studies must be relevant to the review question and compatible with the chosen synthesis approach. A shared topic label does not necessarily mean that studies investigate the same phenomenon, population, context, or type of experience.

06 · What This Means for You

Ask What Kind of Evidence Could Actually Resolve Your Uncertainty

Before selecting QES, complete one sentence: “After this review, I need to understand...” If the remainder concerns experiences, perceptions, meanings, behaviors, acceptability, implementation, contextual influences, or explanations grounded in people's perspectives and actions, qualitative evidence may be central to the answer.

A simple decision framework

If you need to estimate whether or how much an intervention changes an outcome
Use an appropriate quantitative evidence-synthesis approach rather than substituting qualitative evidence for an effect estimate.
If you need to understand people's experiences, perspectives, beliefs, meanings, or behaviors
Qualitative evidence synthesis may directly match the review question.
If you need to understand implementation, acceptability, feasibility, or contextual variation
Consider QES, either independently or alongside effectiveness evidence.
If the objective is mainly to map how much qualitative research exists and what topics it covers
A scoping review may fit better than a synthesis intended to integrate qualitative findings.
If the objective is broad conceptual or historical interpretation across many forms of scholarship
Consider whether a narrative review better matches the intended contribution.
If both effects and experiences are necessary for the decision
Consider linked qualitative and intervention reviews or an appropriate mixed-method review design rather than forcing both questions into one evidence type.

If QES is the appropriate family of review methods, the next decision concerns the particular synthesis methodology. Your question, available studies, intended level of interpretation, theoretical orientation, team expertise, resources, and intended audience can all influence that choice.

It is also worth deciding early whether the project requires a formal protocol. A systematic qualitative synthesis involves enough methodological decisions that planning the review protocol before conducting the synthesis can make the eventual analysis considerably more defensible.

07 · A Quick Checklist

Check Whether Qualitative Evidence Synthesis Fits the Question

Before choosing qualitative evidence synthesis, check:
State the uncertainty the review needs to resolve and determine whether it requires qualitative rather than primarily quantitative evidence.
Define the relevant population or perspective, phenomenon of interest, and context clearly enough to guide study eligibility.
Confirm through preliminary searching that relevant primary qualitative research exists.
Examine whether the available studies contain sufficiently relevant qualitative findings or data for the intended synthesis.
Decide whether the qualitative synthesis should stand alone or complement quantitative effectiveness evidence.
Choose a qualitative synthesis methodology that matches the review question and intended analytical output rather than treating all QES methods as interchangeable.
Plan systematic searching, study selection, methodological appraisal, extraction, and synthesis using current guidance appropriate to the chosen methodology.
Consider how confidence in individual synthesis findings will be assessed when the review will inform decisions or recommendations.
08 · Frequently Asked Questions

Questions About Choosing Qualitative Evidence Synthesis

Is qualitative evidence synthesis the same as a qualitative systematic review?

The terms are often used closely, although terminology varies across methodological traditions. Qualitative evidence synthesis is a broad term covering systematic approaches to synthesizing qualitative evidence, while specific review and synthesis methodologies may use more precise labels.

Can qualitative evidence synthesis be used without an intervention review?

Yes. Cochrane recognizes QES as a standalone review as well as an approach that can accompany an intervention review or form part of a mixed-method review. Whether effectiveness evidence is needed depends on the review question.

Can qualitative evidence synthesis tell me whether an intervention works?

Not in the same sense as an effectiveness review designed to estimate intervention effects. QES can help explain how an intervention is experienced, why implementation succeeds or fails, what influences acceptability, and how context shapes its operation. Those findings can complement but do not replace appropriately synthesized effectiveness evidence.

Can mixed-method studies be included in a qualitative evidence synthesis?

Potentially. Cochrane notes that qualitative evidence or data may come from qualitative components of mixed-method studies. Eligibility should depend on whether the relevant qualitative component meets the review's criteria and provides usable evidence for the chosen synthesis approach.

What framework should I use to formulate a qualitative review question?

Several frameworks are available. Cochrane discusses approaches including SPICE, SPIDER, and PerSPecTIF, while JBI qualitative review guidance emphasizes participants, phenomena of interest, and context. Framework choice should support the question rather than force it into inappropriate categories.

Do I need to critically appraise qualitative studies before synthesis?

Systematic QES methodologies generally include consideration of methodological quality, although the tools and the role appraisal plays in synthesis can vary by approach. Follow current guidance for the particular methodology rather than applying a quantitative risk-of-bias tool to qualitative research.

How is qualitative evidence synthesis different from meta-synthesis?

Qualitative evidence synthesis is a broad family of approaches, whereas meta-synthesis may be used more specifically for forms of qualitative synthesis and is itself used inconsistently across the literature. The important issue is to name and describe the actual synthesis methodology rather than rely on a broad label. The distinction between meta-synthesis and meta-analysis is especially important because their analytical purposes and evidence types differ fundamentally.

Can I assess confidence in findings from a qualitative evidence synthesis?

Yes. GRADE-CERQual is an established approach for assessing confidence in individual qualitative synthesis findings. It considers methodological limitations, coherence, adequacy, and relevance. Other methodological traditions may use different approaches, so the assessment method should fit the review methodology and purpose.

09 · The Bottom Line

Use Qualitative Evidence Synthesis When the Question Requires Understanding

The Bottom Line

Qualitative evidence synthesis is often the best approach when answering the review question requires systematically integrating evidence about experiences, perspectives, meanings, behaviors, implementation, or context rather than primarily estimating an effect or frequency.

Start with the uncertainty, not the method. If qualitative evidence provides the information needed to resolve that uncertainty, determine whether sufficient relevant evidence exists and select a synthesis methodology suited to the question and intended output. When both effects and experiences matter, qualitative and quantitative syntheses may be complementary rather than competing alternatives.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes