01 · The Question
How can you tell whether qualitative researchers went deep enough?
A paper reports that researchers conducted semistructured interviews, focus groups, observations, or another qualitative form of data collection. That tells you how the data were generated, but not necessarily how good those data were.
An interview can last an hour and remain superficial. A shorter conversation can sometimes produce remarkably detailed evidence when the participant has relevant experience and the interviewer follows important ideas skillfully. Likewise, dozens of pages of field notes do not guarantee that an observation captured the processes the study claims to explain.
The appraisal problem is therefore not simply how much data researchers collected. You need to ask whether the data contain enough detail, specificity, variation, and contextual meaning to support the analysis that follows.
03 · What You Need to Know
Depth comes from the quality of inquiry, not simply the amount of data
Deep data move beyond brief opinions
Suppose a researcher asks a teacher, "Do you find generative AI useful?" The teacher answers, "Yes, sometimes." Technically, the researcher has collected qualitative data. Analytically, however, there is very little to work with.
A skilled follow-up might ask what "sometimes" means, request a specific classroom example, explore when the technology was not useful, ask what happened after it was introduced, or investigate why the teacher made a particular decision. The resulting account may reveal conditions, contradictions, sequences, interpretations, and consequences that the initial answer concealed.
Depth therefore concerns the explanatory and interpretive potential of the material. Rich data often allow researchers to examine not merely what participants say, but how they understand an experience, how events unfolded, why circumstances mattered, and where experiences differ.
Probing is one important route to depth
Semistructured interviews are particularly useful because the interviewer can retain a common set of topics while responding to what each participant says. Published qualitative protocols and studies commonly describe open-ended questioning combined with probes that pursue important or unexpected issues.
Good probing is not the same as repeatedly asking for more information. It follows the substance of the participant's account. Researchers might ask for an example, clarification, chronology, explanation, comparison, exception, or reflection on an apparent contradiction.
That responsiveness matters because the most informative material may not have been anticipated when the interview guide was written. If every participant is marched through identical questions without meaningful follow-up, a nominally semistructured interview can behave suspiciously like a questionnaire with longer answer boxes.
An interview guide can support depth or constrain it
A topic guide provides useful consistency across interviews. It can ensure that central aspects of the research question are addressed and help researchers compare experiences across participants. Yet an overly rigid or overloaded guide can work against depth.
If an interviewer must cover 35 questions in 30 minutes, participants may have little opportunity to develop their answers. Researchers may collect something about everything but understand very little about anything.
By contrast, broad open-ended questions, strategically chosen prompts, and flexibility to pursue relevant emerging issues can support richer accounts. Some qualitative designs also revise interview guides during data collection as analysis reveals concepts that warrant further exploration.
Specificity is often more revealing than eloquence
Rich qualitative evidence does not require participants to sound philosophical. A concrete description of an event can be analytically valuable even when expressed in ordinary language.
Imagine a participant saying, "The system made my work harder." That statement becomes more informative when the researcher establishes what task became harder, what the participant previously did, what changed, who else was involved, what consequences followed, and whether the problem occurred repeatedly or under particular conditions.
Specific incidents can help researchers distinguish general evaluations from evidence about actual practices and experiences. The appropriate level of detail still depends on the research question and methodological approach.
Depth can come from observation, documents, and other forms of data
It would be a mistake to equate qualitative depth exclusively with long interviews. Ethnographic observation, field notes, documents, recordings of interactions, diaries, visual material, and other sources may provide forms of evidence that interviews cannot.
For example, participants may describe how a workplace procedure normally operates, while observation reveals interruptions, informal workarounds, nonverbal interactions, or contextual constraints that are difficult to reconstruct retrospectively. Some qualitative case-study designs intentionally combine several sources to examine a phenomenon from different vantage points.
The relevant question remains the same: did the chosen method generate evidence appropriate to what the researchers wanted to understand?
Duration is evidence about procedure, not a quality threshold
Interview length can be informative. Ten-minute interviews would reasonably raise questions in a study claiming exhaustive exploration of complex life histories. But there is no universal duration at which an interview suddenly becomes "in-depth."
The appropriate length depends on the question, participants, interview structure, phenomenon, setting, and analytical ambition. Published qualitative studies and protocols vary considerably in anticipated and actual interview duration.
Watch Out
Do not convert interview duration into a methodological cutoff. "Each interview lasted 60 minutes" describes the data collection procedure. It does not demonstrate that participants were probed effectively or that the resulting material was sufficiently rich.
Depth should be considered across the dataset, not only within individual interviews
A study can contain several excellent interviews and still have important evidential gaps. Perhaps one participant group provided detailed accounts while another was barely explored. Perhaps researchers discovered a major issue late in data collection but never returned to it with earlier participants.
This is one reason iterative qualitative designs can be valuable. When data collection and analysis occur alongside one another, researchers can identify emerging concepts, revise questions, pursue discrepancies, and seek additional evidence.
Depth therefore has both an individual and dataset-level dimension. You want rich accounts, but you also want sufficient exploration of the concepts needed to answer the study's question.
Depth and sample adequacy answer different questions
A study can have an adequate qualitative sample in terms of who was included yet collect thin data from those participants. The reverse is also possible: a few exceptionally detailed interviews may still leave important participant perspectives absent.
Sampling asks whether the study obtained evidence from enough appropriate cases. Data-collection depth asks whether researchers learned enough from those cases. Both matter, but one cannot compensate automatically for weaknesses in the other.
06 · What This Means for You
Look for evidence that researchers pursued meaning rather than merely covered topics
When appraising a paper, reconstruct the data-collection process as far as the report permits. Who collected the data? What training or relevant experience did they have? Was the format structured, semistructured, or open? Were interviews recorded? Were field notes made? Were researchers able to probe? Did the guide change as new issues emerged?
COREQ specifically prompts reporting about the interviewer, interview guide, repeat interviews, recording, field notes, duration, saturation, and related features for interview and focus-group research. The broader qualitative reporting literature likewise emphasizes transparent description of how data were collected.
A simple appraisal framework
If answers appear brief, generic, or dominated by predetermined categories
Ask whether the evidence is sufficiently detailed for the interpretive claims being made.
If researchers used semistructured interviews
Look for evidence of meaningful probing and flexibility rather than merely the existence of an interview guide.
If important concepts emerged during the study
Check whether researchers explored them further through later interviews, additional cases, observations, or other appropriate data.
If the phenomenon depends heavily on setting or interaction
Consider whether interviews alone could capture what the study claims, or whether contextual observation or other evidence would have strengthened the inquiry.
If the paper gives little information about data collection
Distinguish inadequate reporting from demonstrated methodological weakness. You may be unable to judge depth confidently from the published report.
That last distinction matters. Absence of methodological detail in an article is evidence of a reporting problem, but it does not necessarily prove that the researchers conducted shallow interviews. Your appraisal should not claim more than the paper allows you to know.
07 · A Quick Checklist
Before deciding whether qualitative data collection was deep enough, check:
When appraising data-collection depth, check:
Identify what kind of evidence the research question required: experiences, meanings, processes, interactions, practices, contexts, or something else.
Check whether the chosen data-collection method could realistically generate that evidence.
Look for open-ended questioning and meaningful probing when interviews or focus groups were used.
Look for concrete examples, contextual detail, exceptions, explanations, and variation rather than brief statements of opinion alone.
Check whether emerging ideas could influence subsequent data collection when the methodological approach called for iteration.
Consider whether relevant perspectives or dimensions of the phenomenon remained conspicuously unexplored.
Do not use interview duration, transcript length, or participant count as standalone evidence of depth.
Check whether the authors report enough about the process for you to make a defensible judgment at all.
11 · Cite this Guide
How to Cite This Guide
This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.
Recommended (Field Guide)
APA
MLA
Chicago
Copy Citation
