Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

When Does Studying Another Population Improve Fairness Rather Than Merely Add Another Subgroup?

Studying another population improves fairness when it changes who can shape, contribute to, or benefit from the evidence, not simply when another demographic category appears in the sample. The relevant question is what inequity the research actually addresses.

599
When Does Studying Another Population Improve Fairness? Guide 599 of 760
01 · The Question

When does adding another population actually make research fairer?

A researcher notices that a population is poorly represented in the literature and proposes a new study focused on that group. The proposal describes the project as more inclusive, equitable, or fair because people previously missing from the evidence will finally be studied.

That may be true. It is not automatic.

A population can be added to a study without changing who defines the research problem, who bears the burden of participation, whose outcomes matter, who receives the benefits, or whether the resulting evidence addresses any inequity at all. The difficult question is therefore not whether another subgroup has entered the dataset. It is whether the research changes something consequential about the distribution of evidence, participation, influence, or benefit.

02 · The Short Answer

Fairness requires more than demographic expansion

In Brief

Studying another population can improve fairness when it addresses a meaningful inequity in whose needs are investigated, whose experiences inform the evidence, who can participate, whose outcomes are considered, or who can benefit from research-based decisions.

Simply adding an underrepresented subgroup does not necessarily make research fairer. You need to identify the inequity being addressed and show how the study changes it rather than treating demographic representation as a proxy for equity.

03 · What You Need to Know

Fairness concerns the structure of research, not just the composition of the sample

Representation and fairness overlap, but they are not the same thing

Representation asks who appears in research. Fairness asks a broader set of questions about how research opportunities, burdens, influence, evidence, and benefits are distributed.

Adding representation A previously uncommon or absent population participates in the research or becomes visible in the analysis.
Improving fairness The research addresses a meaningful inequity in participation, knowledge, decision-making, burdens, priorities, or access to the benefits produced by research.

The distinction matters because demographic inclusion can be genuine while the rest of the research process remains unchanged. Researchers may recruit a population into a question defined entirely elsewhere, measure outcomes of little relevance to that population, impose substantial participation burdens, and ultimately produce findings that provide the population little benefit.

That study may have broader representation. Whether it is fairer requires a separate argument.

Fairness becomes relevant when evidence and consequences are distributed unevenly

One of the clearest cases arises when a population is affected by research-based decisions but contributes little to the evidence supporting those decisions.

Suppose an intervention, policy, educational technology, or service is intended for a broad population. If evidence about its effectiveness, usability, safety, or implementation repeatedly comes from a narrower population, people outside that evidence base may still experience the consequences of adoption.

Research with the missing population can reduce that imbalance. The rationale is stronger when the population's absence also limits confidence in the evidence being applied to it.

Importantly, fairness does not require researchers to predict that the population will produce a different effect. The inequity may lie in routinely making decisions for people without obtaining relevant evidence from or with them.

Fairness can concern who has the opportunity to participate

Underrepresentation is sometimes produced by the mechanics of research itself. Eligibility criteria, inaccessible study procedures, language restrictions, narrow recruitment networks, transportation requirements, digital access assumptions, compensation practices, or the location and timing of data collection can systematically make participation easier for some people than others.

In such cases, studying another population may improve fairness when researchers change those conditions rather than merely search harder for participants who can tolerate them.

For example, recruiting people with disabilities into a digital study while retaining an inaccessible research platform would technically broaden the eligibility criteria without creating equitable access to participation. Similarly, translating a recruitment advertisement while leaving consent procedures, instruments, and support inaccessible in the relevant language may achieve little.

Meaningful inclusion asks what prevented participation in the first place.

Fairness can concern what researchers choose to know

Evidence gaps are not created only by missing participants. They can also arise because some questions receive extensive research attention while problems important to particular populations remain peripheral.

A community may already appear in research, but primarily as the object of studies about risk, deficiency, compliance, pathology, or other researcher-defined problems. Studying that population again does not necessarily correct the imbalance.

A fairer research agenda may instead examine questions the population identifies as consequential, study institutional or structural conditions rather than treating population identity as the problem, or investigate outcomes that matter in everyday life.

This is why the question of who should decide which research questions matter cannot always be separated from discussions of equity.

Fairness can concern who has influence over the research

There is a substantial difference between recruiting participants and sharing meaningful influence over a project.

Community-engaged and community-based participatory approaches provide one model for moving beyond participation alone. Community-based participatory research, for example, has been characterized by collaborative partnerships, attention to community-identified issues, co-learning, mutual benefit, and equitable involvement across stages of research. These principles do not mean every population-specific study must become community-based participatory research. They do show that research relationships can be structured in ways that distribute influence differently.

The appropriate degree of involvement depends on the question. A laboratory study of a narrowly specified mechanism may require something quite different from research seeking to define a community's priorities, experiences, or responses to an institutional problem. For the latter, community involvement may need to begin before the study is designed.

Fairness can concern who bears the burden and who receives the benefit

Participation is not costless. Participants contribute time, information, experiences, biological materials in some fields, and sometimes considerable emotional or practical effort. Communities may repeatedly provide data while seeing few improvements in the conditions researchers document.

A fairness argument should therefore ask what participants or communities can reasonably expect from the research. Benefit need not mean direct payment or an immediate intervention. Research can produce knowledge, visibility, improved services, locally useful information, capacity, or evidence relevant to policy. But researchers should be wary of describing a project as equitable merely because a historically excluded population supplies data.

This concern becomes especially important when researchers repeatedly study the same disadvantaged communities because their problems are academically interesting while the resulting benefits accrue primarily to institutions, careers, or publications.

Do not confuse equality with equity

Treating everyone identically can preserve unequal participation when people encounter different barriers.

Imagine that all participants must attend a two-hour weekday session at a university laboratory. The rule is equal. Yet it may systematically exclude people whose employment, caregiving responsibilities, disability, transportation access, or geographic location makes attendance difficult.

Improving fairness may require different recruitment pathways, accessible formats, scheduling options, compensation arrangements, or modes of participation. Those adaptations should be justified by actual barriers rather than demographic stereotypes.

Population-specific research can also reproduce unfairness

Researchers should not assume that focusing attention on an underrepresented population is inherently beneficial.

A study can stigmatize a population, define it primarily through deficits, reinforce stereotypes, collect sensitive information without meaningful benefit, or imply that inequalities originate within the population rather than in the systems surrounding it.

This is why researchers should examine the possibility of creating harm by defining a population primarily through a deficit or problem. More research attention is not always better research attention.

Watch Out

Do not use "equity" as a synonym for "our sample is more diverse." If you claim that a study improves fairness, identify the inequity: unequal opportunity to participate, inadequate evidence for affected populations, overlooked priorities, inaccessible research procedures, uneven research burdens, limited influence, or unequal access to benefits. Then show what the study actually changes.

A similar effect can still coexist with a fairer evidence base

Suppose researchers deliberately include a population that has historically been absent and discover that the intervention effect is essentially similar to what previous studies reported.

That does not mean inclusion was pointless. The population now contributes direct evidence relevant to decisions affecting it. Researchers may also learn about accessibility, implementation, acceptability, or participation conditions that an effect estimate alone would not reveal.

This is why inclusion can matter even without an expected different effect. Fairness and effect heterogeneity answer different questions.

04 · A Practical Example

Adding participants is not the same as correcting an inequity

Hypothetical Example

Two ways to study a population missing from educational technology research

Suppose most studies of a digital learning platform involve students at large urban universities. Students from remote campuses have rarely participated, although the same platform is being considered for use across an entire university system.

Approach A: Add the subgroup Researchers recruit a small remote-campus sample, administer the same measures used in previous urban studies, and report whether the average outcome differs.
What changes The demographic composition of the evidence becomes somewhat broader.
Approach B: Address the inequity Researchers first examine why remote-campus students were repeatedly absent and identify connectivity, device access, scheduling, and platform reliability as barriers relevant both to research participation and real-world implementation.
Study design Recruitment procedures are adapted, access conditions are measured, students help identify implementation concerns, and outcomes include both learning and practical ability to use the platform.
What changes The study generates evidence about whether a system intended for these students is actually usable and beneficial under their conditions while reducing barriers that previously kept them out of the evidence base.

Both studies add representation. The second makes the stronger fairness claim because the design identifies and responds to the processes producing the evidential imbalance rather than merely inserting another demographic category into an established protocol.

05 · What Researchers Often Get Wrong

Common mistakes when claiming that population research improves fairness

Misconception

A more diverse sample is automatically a fairer study

Diversity can improve representation, but fairness also concerns access, influence, research priorities, burdens, interpretation, and benefits. Sample composition is one part of a larger research relationship.

Misconception

Fairness requires every population to receive equal research attention

Not necessarily. Research priorities depend on unanswered questions, consequences, population needs, available evidence, and feasibility. Equity does not require mechanically distributing identical numbers of studies across demographic categories.

Misconception

Recruiting an excluded population corrects the exclusion

Recruitment may be only the first step. If procedures remain inaccessible, questions remain irrelevant, participation is burdensome, or findings provide little benefit to the population, the underlying inequity may persist.

Misconception

Researchers improve fairness simply by speaking for an underrepresented population

Researchers can provide valuable expertise, but studying a population does not automatically authorize researchers to define its priorities or speak on its behalf. Some questions warrant direct involvement from people affected by the research.

Misconception

More research attention can only benefit an underrepresented population

Research can also stigmatize, overburden, misrepresent, or repeatedly extract information without meaningful return. Fairness requires attention to the form and consequences of research, not simply its quantity.

06 · What This Means for You

Name the inequity before claiming that your study addresses it

If you want to argue that studying another population improves fairness, write down exactly what is currently unfair. Avoid beginning with an abstract statement about promoting equity.

Perhaps the population receives an intervention supported almost entirely by evidence from elsewhere. Perhaps conventional recruitment procedures systematically exclude it. Perhaps researchers repeatedly study outcomes that institutions value while overlooking outcomes that matter to the population. Perhaps participants provide data but have little influence over questions or interpretation.

Each problem suggests a different research response.

A simple decision framework

If the inequity is inadequate evidence for a population affected by research-based decisions
Generate evidence directly relevant to that population and the decisions being made.
If the inequity is unequal opportunity to participate
Identify and modify the recruitment, eligibility, accessibility, logistical, or institutional barriers producing exclusion.
If the inequity concerns whose priorities define the research
Consider appropriate forms of community or stakeholder involvement in identifying questions, outcomes, and interpretations.
If the study merely adds a demographic category without addressing an identifiable inequity
Describe the benefit as improved representation rather than making a stronger fairness claim that the design does not support.

The distinction is useful because representation itself can still be valuable. You do not need to call every improvement in representation an equity intervention. More precise claims make it easier to evaluate whether the research design actually delivers what the rationale promises.

07 · A Quick Checklist

Before claiming that studying another population improves fairness

Before making an equity or fairness claim, check:
Identify the specific inequity rather than treating underrepresentation itself as the complete explanation.
Determine whether the population is affected by decisions based on evidence from which it has been inadequately represented.
Investigate whether study procedures, eligibility criteria, recruitment, language, accessibility, or logistics contributed to previous exclusion.
Ask whether the research questions and outcomes address issues meaningful to the population rather than merely convenient variables already used elsewhere.
Consider whether members of the population should have meaningful influence over some stages of the research.
Examine how research burdens and potential benefits are distributed.
Check that the study does not frame the population itself as deficient when structural or contextual conditions better explain the problem.
State a narrower representation claim if the design does not actually address a broader inequity.
08 · Frequently Asked Questions

Questions about fairness and population-specific research

Is increasing representation always an improvement?

It can improve the breadth of participation and evidence, but the significance depends on the research question and how inclusion is achieved. Representation can increase without correcting barriers, unequal influence, irrelevant research priorities, or uneven distribution of benefits.

Does fair research require proportional representation of every population?

No universal proportionality rule applies across research. Appropriate representation depends on the target population, research question, design, inferential purpose, and context. Some studies may deliberately oversample a smaller population because adequate evidence about that population is particularly important.

Can research be fair even if the population does not help design it?

Potentially. The appropriate level of involvement depends on the question and context. Community involvement becomes more consequential when researchers are defining community priorities, studying sensitive experiences, designing interventions for local use, or working where previous research relationships have produced mistrust or exclusion.

Can a study improve fairness if it finds exactly the same effect?

Yes. Fairness may concern who has the opportunity to contribute to relevant evidence and whether decisions affecting a population are supported by direct evidence. Similar effects do not erase those considerations.

Does focusing on a historically excluded population automatically make research equitable?

No. The study could reproduce extractive relationships or harmful framing. A stronger justification for research involving a historically excluded population explains what exclusion has left unknown and how the proposed research addresses that problem responsibly.

Is research developed with a community always better than research about it?

No research model is automatically superior for every question. However, when community knowledge, priorities, trust, implementation, or interpretation are central to validity and usefulness, research developed with a community may offer important advantages over a design in which the community only supplies participants.

09 · The Bottom Line

Fairness depends on what changes, not simply who gets added

The Bottom Line

Studying another population improves fairness when it addresses a meaningful inequity in participation, evidence, research priorities, influence, burdens, or access to research benefits rather than merely increasing the number of demographic groups represented.

Identify the inequity first, then design the research to address it. Sometimes that means recruiting people who have been systematically excluded. Sometimes it requires changing inaccessible procedures, asking different questions, sharing influence, or generating evidence relevant to decisions already affecting the population.

10 · Sources and Further Reading

Sources and further reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes