Can Small Qualitative Studies Be Valuable When the Literature Is Sparse?

Can a study with 12 interviews really matter when evidence is scarce?

You find very little research on your topic. Among the available studies is a qualitative investigation based on perhaps 10, 15, or 20 participants. Compared with the sample sizes expected in surveys, cohort studies, or trials, it looks tiny.

Should such a study carry any evidentiary weight?

That question assumes that sample size performs the same function across research designs. It does not.

Qualitative studies are commonly designed to investigate meaning, experience, context, processes, perceptions, implementation, and variation rather than estimate population prevalence or average intervention effects. A small qualitative study may therefore provide evidence that a much larger quantitative study was never designed to produce.

The relevant question is not simply how many people participated. It is whether the study generated sufficiently rich, relevant, and credible data to support the qualitative finding you want to use.

Small qualitative studies can provide evidence that numbers alone cannot

Qualitative evidence answers different questions from effect estimates

Imagine that a trial tells you an intervention had little effect. That finding does not necessarily tell you why.

Did participants find the intervention unacceptable? Was it difficult to implement? Did professionals adapt it in ways the protocol did not anticipate? Did participants understand the intervention differently from its designers? Did institutional constraints prevent it from operating as intended?

These are often qualitative questions.

Cochrane guidance recognizes that qualitative evidence synthesis can improve understanding of intervention complexity, contextual variation, implementation, and stakeholder preferences and experiences. It may be conducted independently or integrated with an intervention review.

Do not evaluate a qualitative sample as though it were a miniature survey

A survey usually uses a sample to estimate characteristics of a larger population. Sample size therefore has a direct relationship to statistical precision under the assumptions of the design.

Qualitative sampling often serves another purpose. Researchers may deliberately select participants because they can illuminate different experiences, contexts, perspectives, or aspects of a phenomenon. The aim may be conceptual understanding rather than statistical representation.

A study with fifteen participants should therefore not be dismissed simply because fifteen would be an inadequate sample for estimating a population proportion.

That would be rather like criticizing a microscope for having a poor field of view. The instrument was built for another task.

Small does not automatically mean thin

The number of participants tells you surprisingly little about the amount of usable qualitative evidence a study contains.

Fifteen lengthy, carefully conducted interviews can generate extensive material about a phenomenon. A study involving fifty participants may produce much thinner data if each participant contributes only a few brief comments.

Cochrane distinguishes the conceptual richness of qualitative evidence from its contextual thickness. Rich evidence offers greater conceptual detail, while thick evidence provides greater contextual detail. Review authors are encouraged to consider these characteristics when understanding the qualitative evidence available.

They are related in some studies, but they are not interchangeable.

Ask whether the sample provides meaningful variation

Although a large sample is not automatically better, sampling still matters.

Suppose a study aims to understand why healthcare workers struggle to implement a new protocol across an entire hospital system but interviews only three senior administrators. The interviews could be rich, yet the sample may not capture the experiences of nurses, physicians, technicians, or frontline staff who encounter different implementation problems.

Likewise, a study examining students' experiences of remote learning might need variation in access to technology, educational level, location, or other characteristics relevant to the phenomenon.

The appropriate question is therefore not “Is 15 enough?” in isolation. Ask whether the participants and data provide adequate access to the experiences or perspectives necessary for the particular finding.

Confidence in qualitative findings depends on more than participant count

GRADE-CERQual provides a structured approach for assessing confidence in findings from qualitative evidence syntheses. It considers four components: methodological limitations of the studies contributing to a finding, coherence of the finding, adequacy of the supporting data, and relevance of those data to the review question.

This framework illustrates why simply counting participants is inadequate. A finding supported by detailed, coherent data from a few highly relevant studies may deserve meaningful confidence, while a finding assembled from larger but poorly relevant or methodologically weak studies may not.

Adequacy includes quantity and richness

Sample size does still matter in a qualified sense. A tiny amount of data can leave a finding fragile, particularly if only one or two participants contribute to a theme or if the available material is superficial.

But adequacy is not reduced to a participant threshold. In qualitative synthesis, researchers consider both the quantity and richness of the data supporting each review finding.

This also means confidence may differ across findings from the same synthesis. One theme might be supported by rich data across several studies, while another rests on a handful of brief observations. Treating the entire qualitative literature as uniformly “strong” or “weak” can hide these differences.

Qualitative evidence can explain why sparse quantitative evidence behaves as it does

One particularly useful role arises when quantitative evidence is small, inconsistent, or difficult to interpret.

Suppose three small trials of an intervention produce different results. Qualitative studies might reveal that implementation differed substantially between settings, that participants found one delivery format unacceptable, or that professionals modified the intervention in response to local constraints.

Those qualitative findings do not increase the statistical precision of the effect estimate. They may, however, substantially improve interpretation.

Cochrane specifically recognizes integration of qualitative evidence with intervention reviews as a way of understanding implementation, contextual variation, and intervention complexity.

Qualitative evidence does not become quantitative evidence when quantitative evidence is missing

This boundary is crucial.

A qualitative study in which participants describe an intervention as beneficial does not estimate how effective the intervention is. Participants' experiences may reveal perceived benefits, mechanisms, acceptability, or unexpected consequences, but those accounts are not substitutes for comparative effect estimates.

Likewise, ten interviewees mentioning a barrier does not mean the barrier affects a calculable percentage of the wider population unless the study was designed to support that form of inference.

Sparse qualitative evidence can still be too indirect

A beautifully conducted qualitative study may investigate participants or contexts that differ substantially from the question you want to answer.

If you are studying barriers to implementation among rural primary-care nurses, rich interviews with physicians in urban specialist hospitals may offer useful conceptual insight while remaining only partly relevant to the target context.

GRADE-CERQual explicitly includes relevance as a component of confidence in qualitative synthesis findings.

The same general problem arises across sparse evidence: expanding to whatever evidence is available can increase information while increasing inferential distance. The question of when broader evidence becomes too indirect therefore applies to qualitative evidence as well.

You may not need every qualitative study to produce a rigorous synthesis

Qualitative evidence synthesis differs from many effect reviews in another interesting respect: including every eligible study is not always necessary or even desirable.

Cochrane guidance notes that study selection and sampling approaches in qualitative evidence synthesis have evolved, and sampling may sometimes be appropriate depending on the synthesis method and review question. The guiding principle is transparency about the decisions and their rationale.

In a genuinely sparse literature, this may be a moot point because only a few studies exist. Still, it reinforces an important principle: qualitative synthesis is not strengthened simply by maximizing the number of studies. Conceptual contribution, relevance, richness, and methodological fit matter.

What can three small interview studies add to two inconclusive trials?

The qualitative studies did not rescue the effect estimate. They answered questions the effect estimate could not.

Small qualitative studies are easily judged using the wrong criteria

Judge qualitative evidence by what it contributes, not how small it looks

When a sparse literature contains small qualitative studies, begin with your research question. Determine what those studies can add that other designs cannot.

This principle also helps when other non-trial evidence appears in a sparse literature. Case reports may matter for rare or novel observations, while qualitative studies may illuminate experience and process. Neither should be evaluated merely by asking where it sits beneath a randomized trial in a generic evidence pyramid.

The design should follow the question. So should your appraisal.

Before dismissing or relying on a small qualitative study

Questions about small qualitative studies

Small samples can produce substantial qualitative evidence

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.