Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Who Should Decide Which Questions Matter for an Underrepresented Population?

Researchers bring methodological and disciplinary expertise, but they are not always the only people qualified to decide which questions matter for an underrepresented population. When research concerns a population's needs, experiences, services, or priorities, people affected by the research may hold knowledge necessary for deciding what is worth studying.

604
Who Should Decide Which Research Questions Matter? Guide 604 of 760
01 · The Question

Who gets to decide what is worth knowing about a population?

Researchers routinely decide which questions deserve study. They review the literature, identify gaps, develop theories, seek funding, and design projects. That expertise matters.

But population-specific research raises another question. If a study is intended to understand or improve conditions affecting an underrepresented population, should researchers alone determine what matters?

The answer becomes particularly important when academic priorities and population priorities do not align. Researchers may see an elegant theoretical gap while people living with the issue regard a different problem as far more consequential. Neither perspective automatically settles the matter. The challenge is deciding whose knowledge is relevant to the question and how different forms of expertise should influence research priorities.

02 · The Short Answer

Research priorities may require both scientific and experiential expertise

In Brief

Researchers should not automatically be the sole decision-makers when a study concerns the priorities, experiences, services, risks, or outcomes of an underrepresented population; people affected by the research may hold essential knowledge about which questions are meaningful and consequential.

This does not mean communities should determine every scientific question or that researcher expertise becomes secondary. The appropriate decision process depends on the purpose of the research, who possesses relevant knowledge, who bears the consequences, and which decisions genuinely benefit from shared priority setting.

03 · What You Need to Know

Different people know different things about what makes a question important

Researchers have legitimate expertise in identifying research questions

Researchers know the literature, theoretical debates, methodological possibilities, unresolved contradictions, measurement problems, and limitations of existing evidence. Those forms of expertise are indispensable.

A researcher may recognize that an apparently practical question has already been answered convincingly, that a proposed comparison cannot support the desired inference, or that a seemingly narrow methodological issue has large consequences for an entire evidence base.

Community engagement should therefore not be framed as correcting the assumption that researchers have nothing useful to contribute to priority setting. They do.

The more defensible argument is that scientific expertise may be necessary without always being sufficient.

People affected by the research possess knowledge researchers may not have

Lived experience can reveal which problems actually create burdens, which outcomes matter in practice, how institutions operate on the ground, what barriers conventional measures overlook, and whether a proposed intervention solves a problem people actually have.

This knowledge is not merely anecdotal decoration added after a literature review. For some research questions, it is evidence needed to define the problem correctly.

Formal priority-setting initiatives demonstrate how different stakeholder groups can contribute to identifying unanswered questions. The James Lind Alliance, for example, brings patients, carers, and clinicians together in Priority Setting Partnerships to identify and prioritize uncertainties about treatments and care. Its model is designed specifically to give these groups influence over research agendas rather than leaving priorities entirely to researchers and funders.

The model comes from health research and should not be treated as a universal template for education, social science, engineering, or other fields. It illustrates a broader principle: the people who experience a problem can possess relevant knowledge about which uncertainties deserve attention.

Ask what kind of question you are trying to choose

Not every research question requires the same decision process.

A highly technical question about the mathematical properties of an estimator may legitimately be driven primarily by methodological expertise. A study asking which barriers prevent a community from accessing a public service relies much more heavily on contextual and experiential knowledge. Research intended to develop an intervention for community use may require yet another arrangement.

Type of question Whose knowledge may be especially important? Why?
Foundational theoretical or methodological question Researchers and relevant technical experts The central uncertainties may depend heavily on disciplinary or methodological knowledge
Question about population experiences or priorities People with relevant lived experience alongside researchers The importance and meaning of the problem may not be visible from published literature alone
Question about professional or service practice Service users, practitioners, researchers, and other affected stakeholders Different groups may see different implementation problems and outcomes
Intervention intended for community implementation Researchers, intended users, implementers, and relevant community partners Scientific effectiveness and real-world usefulness may depend on different forms of knowledge
Policy question affecting an underrepresented population Researchers, affected populations, policymakers, implementers, and relevant experts The decision combines empirical evidence with practical consequences and competing values

The point is not to construct a committee for every hypothesis. It is to recognize when deciding what matters requires knowledge beyond the literature.

The literature can reproduce earlier researchers' priorities

Researchers are taught to identify gaps by reviewing what has already been published. That is sensible, but it creates a subtle circularity.

If previous research systematically prioritized certain questions while neglecting others, a literature-driven gap analysis begins inside the boundaries created by those earlier priorities. Researchers may identify what is missing from the existing academic conversation without asking whether the conversation itself is focused on the right problems.

This issue becomes especially relevant for populations that have historically had little influence over research agendas. A literature may contain many studies about a population while still neglecting questions that population considers important.

Research priority setting can therefore involve more than filling empty cells in a literature matrix. It can involve questioning how the matrix was constructed.

Underrepresentation does not automatically tell you what the population wants studied

Researchers should avoid another shortcut: "This population is underrepresented, so studying anything about it is inherently responsive to its needs."

Underrepresentation identifies a possible evidential problem. It does not tell you which research questions members of the population prioritize. This is why underrepresentation alone is not sufficient justification for every new study.

A population might prefer research on access to services while researchers repeatedly study attitudes. It might want evaluation of institutional practices while researchers focus on individual deficits. It might already be exhausted by descriptive studies documenting a problem everyone recognizes.

If population priorities form part of your rationale, those priorities should be established rather than assumed.

Community priorities are not automatically singular or obvious

"Ask the community" sounds simple until researchers have to decide whom to ask.

Communities contain disagreements, inequalities, institutions, generations, professions, political interests, and different experiences of the issue. Formal leaders may not represent people with less institutional power. Advocacy organizations may emphasize different concerns from unaffiliated community members. People who have time to attend research meetings may differ from those whose circumstances make participation difficult.

Community-engagement guidance therefore cautions against assuming that a single representative can speak for an entire population. CIOMS recommends understanding community dynamics and power inequities and seeking participation from relevant sectors of the community. This guidance was developed for health-related research, but the underlying representational problem is broader.

Community involvement does not reveal one authentic answer waiting to be discovered. It brings additional perspectives into a decision that may remain contested.

Research priorities involve values as well as evidence

Choosing what to study is partly an empirical decision and partly a value judgment.

Researchers can estimate prevalence, characterize uncertainty, evaluate feasibility, and identify potential consequences. Those data can inform priority setting. They cannot, by themselves, determine whether reducing one uncertainty is more important than addressing another.

Priority decisions may involve severity, number of people affected, inequality, feasibility, urgency, scientific opportunity, cost, neglectedness, and likely benefit. Different stakeholders may reasonably weight these considerations differently.

Making those judgments explicit is usually preferable to presenting research priorities as though they emerge mechanically from a literature review.

Researchers still have responsibilities they cannot delegate

Community involvement does not remove researcher responsibility for scientific validity, ethical conduct, methodological appropriateness, or honest interpretation.

A community may strongly prefer a question that available methods cannot answer credibly. Stakeholders may request conclusions the evidence cannot support. Different groups may advocate incompatible priorities.

Researchers should explain these constraints rather than pretending every preference can become a feasible study. Shared priority setting works best when methodological expertise and experiential knowledge constrain and inform each other.

Funders and institutions also shape what gets studied

Researchers and communities are not the only actors setting priorities. Funding calls, journal interests, institutional strategies, policy agendas, commercial incentives, available datasets, and career structures all influence which questions become research projects.

This matters because a study described as "community-driven" may still be constrained by what a funder is willing to support. Conversely, funding mechanisms can deliberately create opportunities for populations and stakeholders to influence research priorities.

Transparency is useful here. Researchers should distinguish questions that genuinely emerged from community priority setting from questions developed academically and later refined through consultation.

Early involvement matters when priorities are supposed to influence design

If researchers claim that community priorities shape the study, involvement must occur while the research question can still change.

Seeking feedback after funding, protocol development, and ethics approval may improve implementation but cannot retroactively turn the original question into a community-selected priority.

This is why some population-specific questions require community involvement before study design.

The timing should match the claimed influence.

Priority setting can improve fairness without making every decision democratic

Inviting affected populations into research priority setting can change whose concerns enter the evidence agenda. This may be particularly important where research-based decisions affect populations that have historically had little influence over the knowledge used to govern services, interventions, or policies.

That can contribute to fairer population research. Yet fairness does not necessarily require every scientific decision to be settled by vote.

Different decisions may appropriately allocate authority differently. Communities may have strong influence over which outcomes matter, researchers over analytical validity, ethics bodies over participant protections, and funders over resource constraints. The important issue is whether the allocation of decision-making authority is justified rather than merely inherited.

Beware of token priority setting

Researchers sometimes invite community members to a workshop, ask them to rank a predetermined list of researcher-generated questions, and then describe the resulting project as community-led.

The exercise may still be useful, but the description overstates what occurred.

Meaningful priority setting requires clarity about who generated candidate questions, who participated, how priorities were ranked, how disagreements were handled, what criteria were used, and what influence the results actually had over the research agenda.

Watch Out

Do not invite people to identify research priorities if there is no realistic pathway for their priorities to influence what gets studied. Consultation without decision relevance can create participation burden while giving researchers little more than an engagement paragraph for the methods section.

Sometimes the most important question challenges the researcher's original framing

A researcher may approach a population wanting to understand why people fail to use a service. Community members may respond that the more important question is why the service was designed in a way that excludes them.

That shift can be intellectually uncomfortable because it changes the unit of explanation. It may also produce a stronger study.

This is one reason researchers should remain alert to deficit framing in population-specific research. Who participates in setting the question can influence where researchers look for the problem.

04 · A Practical Example

When researcher priorities and population priorities point in different directions

Hypothetical Example

What should researchers study about low use of an educational technology?

A research team notices that students from remote campuses use a new digital learning platform less frequently than students at the main campus. The team wants to investigate students' technology acceptance and attitudes.

Researcher priority Test whether perceived usefulness, ease of use, and attitudes predict platform adoption.
Student priority Examine unreliable connectivity, expensive data, device sharing, inflexible assessment deadlines, and platform functions that perform poorly on mobile devices.
What the disagreement reveals Researchers conceptualized the problem primarily as adoption behavior, while students conceptualized it primarily as an access and institutional-design problem.
Research response The team revises the question to examine how attitudes, access conditions, and institutional practices jointly shape platform use.
Why this is stronger The study retains theoretically relevant constructs while incorporating mechanisms that would have remained outside the original research model.

Neither side had to "win." The better question emerged because different forms of knowledge challenged the limits of the original framing.

05 · What Researchers Often Get Wrong

Common mistakes when deciding whose research priorities matter

Misconception

Researchers should always decide because they understand the literature

Literature expertise is essential but may not reveal which problems matter most in practice or which experiences published research has systematically overlooked.

Misconception

The community should always decide because it has lived experience

Lived experience provides indispensable knowledge for some questions but does not replace methodological, theoretical, or technical expertise. Appropriate priority setting combines the forms of knowledge relevant to the decision.

Misconception

One representative can tell you what the population wants

Populations are heterogeneous. Researchers should consider internal differences and power relationships rather than treating one organization, leader, or participant as a universal spokesperson.

Misconception

A literature gap automatically deserves priority

A question can be absent from the literature because it has been neglected, but absence does not establish importance. Priority also depends on consequences, relevance, uncertainty, feasibility, and the people affected.

Misconception

Community involvement means researchers must accept every proposed question

No. Researchers should evaluate scientific value, feasibility, ethics, and existing evidence while explaining constraints transparently. Engagement creates informed decision-making, not an obligation to convert every suggestion into a study.

Misconception

Ranking researcher-generated questions is automatically community-led priority setting

It may provide useful consultation, but the degree of community influence depends on who generated the options, who participated, how decisions were made, and whether the resulting priorities actually shaped the research agenda.

06 · What This Means for You

Match decision-making authority to the knowledge the question requires

Before deciding who should help choose a research question, ask what makes the question important and who is positioned to know that.

If importance depends primarily on an unresolved theoretical contradiction, specialist researchers may reasonably take the lead. If importance depends on whether an issue disrupts people's lives, whether an outcome is meaningful, or whether an intervention addresses the right problem, affected populations may hold knowledge the research team cannot substitute.

A simple decision framework

If the question is primarily theoretical or methodological
Researcher and technical expertise may appropriately have the largest role in identifying the priority.
If the question concerns population priorities, experiences, barriers, or meaningful outcomes
Include people with relevant lived experience while the research question is still open to change.
If the study will inform a service, intervention, or policy affecting the population
Consider input from intended users, implementers, affected communities, researchers, and other relevant decision-makers.
If different parts of the population may hold different priorities
Use a process capable of representing disagreement rather than searching for one supposedly authentic community view.
If community input cannot realistically influence the research agenda
Do not describe the project as community-prioritized. Be transparent about the narrower role participants can actually play.

The aim is not to remove researchers from research priority setting. It is to avoid assuming that disciplinary expertise confers complete knowledge of what matters to people whose lives, services, or communities are being studied.

07 · A Quick Checklist

Before deciding which population-specific questions deserve priority

Before fixing the research priority, check:
Identify what kind of expertise is needed to judge whether the question matters.
Verify the state of the literature so participants are not asked to prioritize questions that have already been adequately answered.
Determine whether lived experience or contextual knowledge could reveal priorities not visible in published research.
Include relevant population perspectives before the question is fixed if you claim those perspectives shaped the research priority.
Avoid treating one individual, leader, organization, or advisory group as representative of an entire heterogeneous population without justification.
Make the criteria for prioritization explicit, including scientific uncertainty, relevance, consequences, feasibility, and likely value.
Explain how disagreements between researchers, community members, practitioners, and other stakeholders will be handled.
Distinguish genuine shared priority setting from consultation on researcher-defined options.
Ensure that asking people for priorities creates a realistic pathway for those priorities to influence research decisions.
08 · Frequently Asked Questions

Questions about who should set research priorities

Should communities decide what researchers study?

Sometimes they should have substantial influence, particularly when research concerns their priorities, experiences, services, or locally meaningful outcomes. Other questions legitimately depend more heavily on theoretical or technical expertise. The appropriate allocation of influence depends on the research purpose.

Does lived experience count as expertise?

Yes, for questions where direct experience provides knowledge about consequences, barriers, priorities, implementation, or meaning. It is a different form of expertise from methodological or disciplinary training, and the two can be complementary.

How do I know who represents an underrepresented population?

Often no individual does. Identify the sectors and perspectives relevant to your question and consider whose voices may be systematically easier or harder to reach. Representation should be treated as a design problem rather than solved by appointing one spokesperson.

What if community priorities are not novel enough for publication?

First verify whether the question has genuinely been answered for the decision or context that matters. If it has, repeating it solely because it was prioritized may have limited value. If publication incentives systematically discourage questions with strong practical value, however, that tension should be recognized rather than automatically treating journal novelty as the only criterion of importance.

What if researchers and community members disagree about what matters?

Disagreement is normal. Make the criteria and constraints explicit, examine why priorities differ, and use a transparent process rather than assuming one side must automatically prevail.

Does asking a community to rank research questions count as co-design?

Not necessarily. It is a form of involvement, but co-design usually implies more substantive shared development of the research. Describe what community members actually influenced rather than choosing the strongest participation label available.

When should research about a community become research with that community?

The case becomes stronger when community priorities, contextual knowledge, implementation, sensitive interpretation, or trust are central to the study's validity and usefulness. Whether research developed with a community is more valuable than research merely about it depends on what meaningful collaboration contributes to the question.

09 · The Bottom Line

The people who understand the literature are not always the only people who understand the problem

The Bottom Line

Researchers should retain responsibility for scientific rigor, but they should not assume exclusive authority over which questions matter when an underrepresented population possesses knowledge essential to understanding the problem, its consequences, or the outcomes worth pursuing.

Match influence to relevant expertise. Bring affected populations into priority setting when their lived and contextual knowledge can change what deserves study, while preserving transparent attention to evidence, feasibility, ethics, and methodological validity. The goal is not to replace researcher judgment but to prevent it from being mistaken for the only legitimate perspective.

10 · Sources and Further Reading

Sources and further reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes