Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

When Does an Underrepresented Population Need Its Own Study?

An underrepresented population does not automatically need its own study. A stronger case exists when its limited representation leaves an important question unanswered, makes existing evidence uncertain or poorly applicable, or prevents the population's circumstances and priorities from being studied adequately.

594
When Does an Underrepresented Population Need Its Own Study? Guide 594 of 760
01 · The Question

When does missing representation become a research problem of its own?

You review the literature and notice something striking: a population that matters to your topic appears rarely, appears only in very small numbers, or is absent altogether. Perhaps most previous studies were conducted with university students from large cities, while you are interested in working adults in rural communities. Perhaps an intervention has been evaluated extensively, but people with disabilities were routinely excluded. Or perhaps a population appears in large datasets but is combined with other participants so that little can actually be learned about its experiences.

That looks like a research gap. But there is a harder question underneath it: does this population actually need a dedicated study?

The distinction matters. A population can be underrepresented in a literature without automatically generating a scientifically meaningful research question. At the same time, repeatedly studying only the populations that are easiest to recruit can leave important uncertainties hidden behind apparently mature evidence. The challenge is therefore not simply to count who has and has not been studied. It is to determine what we cannot adequately know because a population has been missing.

02 · The Short Answer

Underrepresentation matters when it creates a consequential evidence gap

In Brief

An underrepresented population may warrant its own study when its limited inclusion leaves an important population-specific question unanswered, weakens the applicability of existing evidence, conceals relevant experiences or mechanisms, or perpetuates a consequential gap in who benefits from research knowledge.

Underrepresentation by itself is not sufficient justification. The case becomes stronger when you can explain what is uncertain because the population has been missing, why that uncertainty matters, and why a dedicated study is a better way to address it than simply including more members of the population in a broader study.

03 · What You Need to Know

The real question is what the existing evidence cannot tell you

Start by defining what you mean by underrepresented

"Underrepresented population" is a relational term. A group is not inherently underrepresented. It is underrepresented relative to something: the population affected by a problem, the population expected to use an intervention, the population to which conclusions are being applied, or the population whose experiences are relevant to the research question.

This distinction prevents a common conceptual shortcut. A population does not need to constitute a large percentage of the general population to matter scientifically. Conversely, a numerically large population may still be poorly represented in a particular body of research.

Representation can also be more complicated than whether participants were technically present. A population may have been included in previous samples but in numbers too small to support meaningful interpretation. It may have been absorbed into a broad category that obscures important variation. Researchers may also have collected demographic characteristics without asking questions that capture the population's particular circumstances.

Population present in the sample Members of the population participated, but the study may not provide interpretable evidence about them specifically.
Population adequately studied The design, measures, analysis, and research question provide evidence that meaningfully addresses the population and the issue being investigated.

Underrepresentation is evidence about the literature, not yet a justification for a study

Suppose you review 30 studies and discover that only two include the population you want to investigate. That is useful information. It establishes a representational gap. It does not yet establish why another study should be conducted.

The next question is causal in the broad scholarly sense: what does the missing representation prevent researchers, practitioners, policymakers, communities, or other relevant decision-makers from knowing?

If the answer is essentially "we have not studied them yet," the justification remains thin. This is why underrepresentation alone may not justify a new study. You need to connect the representational gap to a knowledge problem.

A dedicated study is easier to justify when existing evidence may not transfer well

Many studies implicitly or explicitly ask readers to generalize from a sample to a wider population. That inference becomes less secure when characteristics associated with the population could plausibly affect the phenomenon being studied.

The relevant differences need not be biological. They might involve language, access to technology, institutional treatment, educational opportunity, socioeconomic conditions, occupational context, cultural practices, environmental exposure, discrimination, infrastructure, or other features of the setting in which the phenomenon occurs.

Research on representation in health research illustrates the broader methodological principle. The REP-EQUITY framework, for example, treats representativeness in relation to the relevant population and research objectives rather than as a generic requirement that every sample mirror society. Its authors argue that systematic exclusion can limit generalizability and contribute to inequalities. Likewise, the SAGER guidelines ask researchers to consider whether sex and gender are relevant to the research question and, where appropriate, design studies capable of examining those factors.

The key word is relevant. You do not need to assert in advance that the population will produce a different result. Sometimes the uncertainty itself is important. The better question is whether there is a credible reason that the finding might differ or require qualification in another population, and whether the consequences of remaining uncertain are substantial enough to investigate.

The population may face a question that broader studies were never designed to answer

Sometimes generalizability is not the main issue at all. The population may experience a phenomenon in a way that creates a distinct research question.

Consider research on online learning. A large literature may already examine student satisfaction with online courses. A study involving students with visual impairments might not simply ask whether their average satisfaction score differs from everyone else's. It could investigate how learning-management-system accessibility, compatibility with assistive technologies, inaccessible assessment formats, or instructor practices shape participation. Those questions concern conditions that a generic satisfaction study may never have measured.

In such cases, the rationale is not "this group has been studied less." The rationale is that existing designs have not adequately investigated the phenomenon as it occurs for that population.

Representation and population-specific research are not the same thing

A broader study can sometimes solve the problem. If your only concern is that previous samples contained too few members of a relevant population, improved recruitment, stratified sampling, oversampling, or planned subgroup analysis may be more appropriate than creating an entirely separate study.

A dedicated study becomes more defensible when the research requires something broader studies are unlikely to provide: population-specific questions, tailored measures, sufficient depth, a particular sampling strategy, culturally or contextually appropriate procedures, or sustained attention to experiences that would otherwise remain peripheral.

Evidence problem What may be needed Why
The population is simply too small in existing samples Better inclusion or oversampling in a broader study The underlying research question may remain the same
Existing findings are being applied to the population with little direct evidence Targeted inclusion or a dedicated study The applicability of existing evidence needs examination
The population experiences distinctive conditions relevant to the phenomenon Potentially a dedicated study Generic measures or designs may miss the relevant mechanisms or experiences
The population has been included but analytically collapsed into a broad category Disaggregated analysis or a focused study Presence in a dataset does not guarantee interpretable population-specific evidence
The research question itself concerns the population's priorities or lived circumstances Often a dedicated and potentially participatory study The population is central to the question rather than merely a subgroup variable

You do not always need to predict a different effect

A common objection sounds reasonable: if there is no theoretical reason to expect a different result, why study the population separately?

That question deserves serious consideration, but it does not settle the issue. Research can be valuable for reasons other than demonstrating effect heterogeneity. Direct evidence can establish whether an intervention is feasible, acceptable, accessible, safe, interpretable, or implementable for a population. Inclusion can also matter when a group bears the consequences of decisions based on evidence from which it has repeatedly been absent.

In other words, inclusion may remain important even without an expected different effect. What matters is whether obtaining direct evidence serves a defensible scientific, practical, or ethical purpose.

Ask whether absence reduces confidence in the conclusion you want to make

One useful test is to write down the conclusion supported by the existing literature and then ask who that conclusion is intended to cover.

If researchers repeatedly make a broad claim such as "this intervention improves learning outcomes among university students," yet nearly all supporting studies involve a narrow subset of university students, the problem is not merely demographic imbalance. The scope of the claim may exceed the scope of the evidence.

This is an external-validity problem. A sample can support strong causal inference within the study while still leaving uncertainty about whether the result applies elsewhere. Determining when a missing population limits confidence in existing evidence therefore requires attention to both the intended target population and plausible sources of variation.

Consider consequences, not just uncertainty

Not every uncertainty deserves a new study. Research resources are finite, participants assume burdens, and repeatedly dividing populations into narrower categories can generate studies that are difficult to interpret.

The importance of an evidence gap partly depends on what happens if it remains unresolved. A small uncertainty about a low-stakes descriptive question may not justify a major population-specific project. The same degree of uncertainty may matter considerably more if the evidence informs healthcare, education, public policy, technology design, resource allocation, or access to services.

This is where scientific relevance and equity can intersect. Research may be warranted not because a population is statistically unusual but because decisions affecting that population are already being made using evidence that provides little direct information about them. In those circumstances, studying another population may improve fairness rather than merely add another subgroup to the literature.

Historical exclusion can strengthen the rationale, but it should not replace the research question

A history of exclusion is relevant. It can explain why an evidence gap exists, why conventional recruitment practices repeatedly fail to reach a population, and why the benefits and burdens of research have been distributed unevenly.

Still, historical exclusion should not become a generic sentence inserted into every proposal. A persuasive rationale explains how that history connects to the present research problem. What knowledge is missing? What decisions are affected? What aspects of the population's circumstances have been overlooked? What will the proposed research make possible that the existing literature cannot?

That connection is central when you need to justify research involving a historically excluded population.

Sometimes the case for a study changes how the study should be designed

If the rationale depends on a population's distinctive priorities, experiences, or barriers, researchers should be cautious about designing the entire project first and consulting the population afterward. A technically rigorous study can still ask the wrong question.

For some population-specific projects, early engagement can help determine whether the proposed problem is actually important, whether the terminology and categories make sense, whether recruitment procedures create unnecessary barriers, and whether the measures capture what researchers think they capture. The need for community involvement before study design will vary with the question and context, but it should be considered rather than assumed away.

Watch Out

Do not justify a population-specific study by treating the population itself as the problem. A research gap can be framed around missing evidence, exclusionary systems, inaccessible environments, poorly tested assumptions, or unanswered questions without depicting a community primarily through deficiency. How you define the population and the problem can shape the questions you ask, the variables you measure, and the conclusions readers take away.

04 · A Practical Example

From a demographic gap to a defensible research problem

Hypothetical Example

Does a rarely studied student population need another online-learning study?

Suppose a researcher reviews studies of AI-supported feedback in higher education. Most published studies involve students at large urban universities with reliable personal internet access. Students in geographically remote campuses appear only occasionally. The researcher initially proposes: "Few studies have examined remote-campus students, so this population needs its own study."

That observation establishes underrepresentation, but the justification is still incomplete.

Observation Students at remote campuses are rarely represented in the existing evidence.
Question What relevant conditions might the existing literature fail to capture?
Evidence problem The intervention assumes stable connectivity, frequent platform access, and timely interaction with instructors. These conditions may not hold consistently in the proposed population.
Research consequence Existing studies may establish that the feedback system works under well-connected conditions without establishing whether it remains usable, accessible, and educationally useful under different infrastructure constraints.
Design decision A population-specific study could investigate not only learning outcomes but also access patterns, interruptions, usability, implementation conditions, and how students actually engage with the feedback.

Notice what changed. The study is no longer justified by a demographic sentence saying that "remote students are understudied." It is justified by an identifiable uncertainty linking the population, the intervention, the conditions under which it operates, and the claims researchers want to make.

There is another possible outcome. Suppose further investigation shows that connectivity, access, instructional conditions, and other theoretically relevant factors are essentially comparable, and the proposed study would simply administer the same questionnaire to another convenient sample. In that case, population underrepresentation alone may not provide a compelling reason for a separate study. The researcher may need a stronger question or a different design.

05 · What Researchers Often Get Wrong

Weak arguments for population-specific research

Misconception

"No one has studied this population" automatically establishes a research gap

Novelty of population is descriptive, not necessarily substantive. You still need to establish what becomes knowable, testable, or actionable by studying that population. Otherwise, the project risks becoming replication distinguished mainly by geography or demographics.

Misconception

The population must be expected to behave differently

Not necessarily. A strong study may examine whether existing findings apply, whether an intervention is accessible or feasible, or whether a population's experiences have been inadequately captured. You should have a reason for seeking direct evidence, but that reason does not have to be a prediction of a statistically different effect.

Misconception

Every demographic category deserves a separate study

Categories should be relevant to the research question. Creating increasingly narrow population studies without theoretical, empirical, practical, or ethical justification can fragment the evidence base and encourage post hoc storytelling about differences that may be unstable or meaningless.

Misconception

Including a few participants means the population has already been studied

Participation and evidence are not equivalent. A population may appear in a sample while remaining invisible in the analysis, poorly measured, or too sparsely represented to support the conclusions being drawn about it.

Misconception

A dedicated study is always better than inclusion in a larger one

A separate project carries costs and may not be necessary. Better sampling, oversampling, disaggregated reporting, planned interaction analyses, or more inclusive recruitment may sometimes answer the question more efficiently. The design should follow the evidence problem rather than the desire to label a study population-specific.

Misconception

Researchers can define what matters to the population entirely from the literature

Published research can reveal gaps, but it can also reproduce earlier researchers' assumptions about what deserves measurement. When the study concerns community priorities, experiences, or locally meaningful outcomes, researchers may need substantive involvement from people who know those circumstances directly.

06 · What This Means for You

Build the justification from the unanswered question, not the population label

If you are considering a study because a population is underrepresented, resist writing the justification immediately. First identify the chain of reasoning that connects representation to the research problem.

A useful starting point is to ask four questions: What evidence already exists? In what sense is the population inadequately represented? What important uncertainty follows from that absence? Why is a dedicated study an appropriate way to reduce that uncertainty?

A simple decision framework

If the population is missing but there is no identifiable consequence for the research question
Do not assume a separate study is justified. Look for a substantive question rather than relying on absence alone.
If existing findings are routinely applied to the population but direct evidence is weak
Examine whether the missing evidence creates meaningful uncertainty about applicability, feasibility, safety, effectiveness, interpretation, or implementation.
If the population experiences conditions directly relevant to the phenomenon
Consider whether a focused design is needed to investigate those conditions rather than simply repeating the original study.
If the population only needs adequate representation within a general research question
Consider inclusive sampling, oversampling, stratification, or planned subgroup analysis before creating a separate study.
If the question concerns the population's own priorities, experiences, or definitions of the problem
Consider whether the research question and design should be developed with meaningful input from that population.

Your final justification should therefore move beyond "Population X has received limited research attention." A stronger argument identifies what previous studies have established, who or what settings those findings represent, what remains uncertain for the proposed population, why that uncertainty matters, and how the proposed design addresses it.

There is also a language issue worth taking seriously. Population categories can be administratively convenient while remaining conceptually crude. Avoid implying that membership in a demographic category itself explains an outcome when the relevant mechanisms may instead involve institutions, resources, environments, discrimination, accessibility, policy, or other contextual conditions. Researchers should be particularly careful about defining a population primarily through deficit or problem.

07 · A Quick Checklist

Before proposing a dedicated population-specific study, check the logic

Before claiming that an underrepresented population needs its own study, check:
Define exactly how the population is underrepresented and what comparison or target population makes that judgment meaningful.
Verify whether the population is genuinely absent from the evidence or merely difficult to identify because studies aggregate categories or report demographics poorly.
Identify the specific question that existing research cannot adequately answer because of the population's limited representation.
Explain why the uncertainty matters scientifically, practically, ethically, or for decisions affecting the population.
Consider whether relevant contextual, social, environmental, institutional, technological, or biological factors could affect applicability or interpretation.
Determine whether improved inclusion in a broader study could answer the question instead of conducting a separate population-specific project.
Check whether your measures and research questions actually capture issues relevant to the population rather than merely recording its demographic label.
Consider whether members of the population should help identify the research priorities, outcomes, terminology, recruitment procedures, or interpretation.
Review the framing for deficit assumptions, stereotypes, or claims that attribute contextual inequalities to inherent characteristics of the population.
08 · Frequently Asked Questions

Questions about deciding when population-specific research is warranted

How underrepresented does a population need to be before it deserves its own study?

There is no universal percentage. The relevant question is whether the available evidence is sufficient for the inference or decision you need to make. A small amount of representation may be adequate for one research question and wholly inadequate for another.

Is being absent from previous studies enough to establish novelty?

It establishes one form of novelty, but not necessarily meaningful scholarly contribution. You should explain what new knowledge becomes possible by studying the population and why that knowledge matters.

Do I need evidence that the population will produce different results?

No. You may have a theoretical or empirical reason to expect differences, but direct evidence can also be valuable for assessing applicability, feasibility, accessibility, implementation, experiences, or uncertainty. Avoid inventing a difference merely to justify the study.

Should I conduct a separate study or just recruit more diverse participants?

It depends on the research question. If the same measures and design can answer the question with adequate representation, a broader inclusive study may be preferable. A dedicated study becomes more useful when the population requires focused questions, sufficient analytic depth, tailored methods, or attention to circumstances that a general study would not capture well.

What if the population is too small for conventional sample-size targets?

Small population size does not automatically make research inappropriate. The design, inferential claims, and analytical approach should reflect what is realistically possible. The question becomes whether useful evidence can be generated without pretending to have more precision than the available population permits. The methodological issues involved in research with small populations when conventional sample-size targets are impossible require particular care.

Can a population be well represented numerically but still understudied?

Yes. Participants can be present while the questions, measures, analyses, or reporting provide little population-specific knowledge. Representation should therefore be assessed in relation to what the study is intended to establish, not simply by counting demographic categories.

Who decides whether a population's unanswered question is important?

Researchers contribute disciplinary and methodological expertise, but they are not necessarily the only legitimate judges of importance. For research concerning a community's priorities, services, experiences, or risks, deciding which questions matter for an underrepresented population may require meaningful input from the people affected and other relevant stakeholders.

09 · The Bottom Line

A population needs more than a blank space in the literature

The Bottom Line

An underrepresented population has a strong case for dedicated study when its absence leaves consequential uncertainty, prevents an important population-specific question from being answered, weakens the applicability of existing evidence, or leaves relevant experiences and conditions systematically unexamined.

Begin with what the evidence cannot currently tell you, then determine whether a dedicated study is the right design for closing that gap. Sometimes it will be. In other cases, better inclusion within a broader study will be more informative. The population label should identify whom the evidence needs to serve, not substitute for the research problem.

10 · Sources and Further Reading

Sources and further reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes