Should Patient-Important and Stakeholder-Important Outcomes Influence Outcome Selection?

Whose Priorities Should Determine What a Research Study Measures?

You are designing a study intended to evaluate an intervention that affects patients, students, teachers, or another population.

The research team has identified outcomes based on previous studies, theoretical models, and available instruments. However, people who will experience the intervention may prioritize different consequences.

Patients may care about daily functioning and treatment burden rather than only laboratory indicators. Students may prioritize practical competence and manageable workload rather than platform activity. Teachers may be concerned about instructional autonomy and time demands even when institutional leaders emphasize efficiency.

Should these perspectives influence which outcomes become primary or secondary?

What happens when stakeholders disagree, when some outcomes are difficult to measure, or when participant preferences conflict with regulatory, scientific, or institutional requirements?

Outcome selection requires a defensible way to incorporate stakeholder priorities without treating any single group as the exclusive authority over the research design.

Yes, Stakeholder Priorities Should Inform Outcome Selection When They Are Relevant to the Research Purpose

Integrating Stakeholder Priorities Into Rigorous Outcome Selection

What Are Patient-Important Outcomes?

Patient-important outcomes concern consequences that matter to patients' lives, experiences, functioning, or well-being.

Examples may include survival, symptoms, quality of life, functional ability, treatment burden, and adverse effects.

The appropriate outcomes depend on the condition, intervention, and population.

For example, a laboratory biomarker may be scientifically informative without fully representing whether a patient feels better or functions more effectively.

Conversely, a patient-important outcome can be objectively measured. Survival and functional performance are not necessarily self-reported.

Patient importance therefore concerns the relevance of the result, not simply the measurement method.

What Are Stakeholder-Important Outcomes?

Stakeholder-important outcomes are results considered consequential by individuals or groups with legitimate interests in the research and its implications.

Stakeholders may include participants, practitioners, families, service providers, institutions, policymakers, and communities.

However, these groups do not necessarily have the same priorities.

For example, students may value learning quality and flexibility, teachers may emphasize instructional feasibility, and institutions may prioritize completion rates or resource efficiency.

All may provide relevant perspectives, but their interests should not be assumed to be interchangeable.

Researchers should specify which stakeholders are involved and why their perspectives matter to the research objective.

Patient-Important Does Not Mean Patient-Reported

Patient-important outcomes and patient-reported outcomes are distinct concepts.

A patient-reported measure may capture something important, but self-report alone does not establish importance.

Likewise, an objectively measured outcome may be highly important to patients.

The distinction prevents researchers from confusing the source of measurement with the value of the result.

Why Stakeholder Involvement Matters

Researchers often identify outcomes through literature reviews, conceptual frameworks, and available instruments.

These approaches provide important scientific foundations, but they may not capture every consequence relevant to affected populations.

Stakeholder involvement can reveal overlooked experiences, clarify meaningful changes, and identify potential burdens or harms.

For example, a study of remote learning may initially prioritize academic performance while overlooking accessibility difficulties experienced by students with limited connectivity.

Consultation may help researchers recognize that access reliability and participation burden deserve measurement.

However, engagement does not guarantee better outcomes or eliminate methodological bias.

Its contribution depends on how stakeholders are selected, how their input is obtained, and whether the process genuinely informs decisions.

Core Outcome Sets Provide a Structured Model

A core outcome set identifies a minimum group of outcomes recommended for measurement and reporting in studies addressing a particular condition or research area.

The COMET Initiative promotes the development and use of core outcome sets, particularly in health research.

Such sets can reduce inconsistency across studies and support evidence synthesis.

Their development may involve patients, clinicians, researchers, and other stakeholders through structured consensus processes.

However, a core outcome set does not necessarily determine which outcome must be primary in every study.

Nor does it automatically specify the measurement instrument or assessment time for each outcome.

Researchers may need additional study-specific outcomes beyond the core set.

Stakeholder Engagement Should Begin Before Outcomes Are Finalized

Stakeholder input is most useful when it can still influence the research design.

If researchers consult participants only after selecting and finalizing every outcome, the engagement may have little practical effect.

Early involvement can help identify missing outcome domains and assess whether proposed measures correspond to meaningful experiences.

For example, patients may identify treatment burden as important before researchers finalize the primary and secondary outcome structure.

In educational research, students and teachers may identify instructional consequences that are not represented by achievement scores alone.

Researchers should document how input was considered rather than merely stating that stakeholders were consulted.

Who Should Be Involved?

The relevant stakeholders depend on the research question and intended use of the findings.

For a patient-centered intervention, patients and caregivers may provide essential perspectives.

For an educational intervention, students, teachers, and other affected groups may contribute different forms of knowledge.

For a policy evaluation, service users, practitioners, administrators, and policymakers may have legitimate interests.

However, involving only readily available representatives can produce an incomplete picture.

Researchers should consider diversity in experiences, circumstances, access, and potentially conflicting interests.

Stakeholder representation should be justified in relation to the population affected by the research.

Stakeholder Priorities May Differ Within the Same Group

Patients with the same diagnosis may differ in which outcomes they value most.

Students in the same course may have different priorities depending on employment, caregiving responsibilities, disability-related needs, technological access, or previous learning experiences.

Researchers should avoid treating one advisory participant or a small convenience group as the voice of an entire population.

Structured engagement may help identify shared priorities while preserving important differences.

Where preferences vary substantially, researchers should consider whether the outcome set adequately represents the range of consequential experiences.

Consensus does not necessarily mean that all participants assign identical importance to every outcome.

How Can Stakeholders Help Identify Outcomes?

Several approaches can be used, depending on the study's resources and objectives.

No single approach is universally superior.

Researchers should select methods appropriate to the purpose and explain how participation and decisions were organized.

Delphi Methods Can Support Outcome Prioritization

Delphi processes commonly use repeated rounds of structured judgments, often with controlled feedback, to examine priorities or develop consensus.

They have been used in core outcome set development.

For example, patients and professionals may rate the importance of candidate outcomes across successive rounds.

However, consensus thresholds, stakeholder group representation, and procedures for handling disagreement should be specified transparently.

A high consensus percentage does not automatically establish that an outcome is scientifically valid or that the panel represents the entire affected population.

Researchers should distinguish agreement about importance from evidence about measurement quality.

Outcome Importance and Measurement Validity Are Separate Decisions

Stakeholders may identify an outcome as important even when no suitable instrument is immediately available.

For example, students may prioritize the ability to evaluate AI-generated feedback critically.

Researchers may then need to develop or select an assessment that adequately represents that competence.

Choosing an existing satisfaction questionnaire would not necessarily solve the measurement problem.

The COSMIN framework provides guidance on evaluating outcome measurement instruments, particularly patient-reported measures.

The general principle is that identifying what matters and determining how to measure it are related but distinct methodological tasks.

See what makes an outcome measure appropriate.

Stakeholder Importance Does Not Automatically Make an Outcome Primary

An outcome may be highly important to stakeholders without being the primary outcome of a particular study.

For example, an intervention study may have academic performance as its primary outcome while measuring workload as an important secondary outcome.

Whether workload should also be primary depends on the research objective and the intended decision rule.

If the intervention is considered acceptable only when it improves performance without increasing workload beyond a defined threshold, the outcome strategy may need to reflect both dimensions.

Researchers should distinguish stakeholder importance from inferential hierarchy.

The latter determines how outcomes contribute to the study's formal claims.

How Should Conflicting Stakeholder Priorities Be Handled?

Different stakeholder groups may value different outcomes.

For example, institutional administrators may emphasize course completion, teachers may prioritize instructional quality, and students may emphasize meaningful learning and manageable workload.

These priorities can conflict.

Researchers should avoid resolving the disagreement automatically in favor of the group with the greatest institutional authority.

Instead, the process should clarify the research purpose, the interests at stake, and the rationale for including or excluding particular outcomes.

Structured prioritization may help, but numerical rankings do not eliminate the need for judgment.

Consequential disagreements should be documented rather than concealed beneath a claim of universal consensus.

Power Differences Can Affect Stakeholder Engagement

Stakeholder consultation occurs within social and institutional relationships.

Patients may feel reluctant to disagree with clinicians. Students may hesitate to challenge teachers or administrators. Employees may be concerned about expressing views that conflict with organizational priorities.

These dynamics can influence which outcomes are proposed and how strongly preferences are expressed.

Researchers should consider facilitation procedures, confidentiality, accessible participation formats, and opportunities for different groups to contribute independently.

Separate stakeholder rating groups or anonymous responses may be appropriate in some settings.

However, no engagement procedure completely eliminates power differences.

The aim is to recognize and reduce avoidable distortions in the prioritization process.

Meaningful Engagement Requires More Than Consultation

Inviting stakeholders to attend a meeting does not establish that they influenced the research.

Meaningful engagement involves opportunities to contribute to decisions and an explanation of how those contributions were considered.

For example, an advisory panel might identify a missing outcome domain, recommend changes to an instrument, or question whether a proposed endpoint reflects participants' experiences.

Researchers should document whether such recommendations were adopted, modified, or declined and why.

The Patient-Centered Outcomes Research Institute provides resources for engaging patients and other stakeholders in research.

These resources emphasize engagement as a substantive research activity rather than a ceremonial endorsement.

Outcome Selection Should Consider Benefits and Harms

Interventions can have unintended consequences.

For example, an educational technology intervention may improve task completion while increasing workload or creating accessibility difficulties.

Patients may experience treatment benefits alongside adverse effects or burdens that matter to daily functioning.

Stakeholder engagement can help identify these consequences before the outcome set is finalized.

However, the study should still evaluate whether each proposed outcome can be measured appropriately and whether the sample and design support its analysis.

Outcome selection should not focus exclusively on the intervention's intended benefits when important adverse consequences are plausible.

Core Outcomes and Study-Specific Outcomes Can Coexist

Where a relevant core outcome set exists, researchers should consider whether it is appropriate for their population and research question.

Using common outcomes can improve comparability and support evidence synthesis.

However, a core set is generally a minimum rather than an exhaustive list.

A particular study may require additional outcomes reflecting its intervention, context, or stakeholder priorities.

Researchers should also evaluate whether the recommended measurement instruments and timing are suitable.

Adopting a core outcome set without considering the study's objectives can create its own form of misalignment.

Stakeholder Engagement Has Resource and Ethical Implications

Meaningful involvement requires planning.

Researchers may need accessible materials, appropriate compensation or reimbursement, flexible scheduling, facilitation, and support for contributors unfamiliar with research terminology.

These arrangements should be proportionate and ethically appropriate.

Researchers should also distinguish participation in outcome-prioritization activities from participation as research subjects when the applicable governance arrangements differ.

Engagement should not impose excessive demands on people whose perspectives the study seeks to include.

Careful planning can help avoid a situation in which consultation becomes another burdensome activity with little influence on the final design.

How Should Stakeholder Involvement Be Reported?

Researchers should describe who contributed, how they were recruited, what methods were used, and how priorities influenced the outcome selection process.

Where consensus procedures were used, the reporting should explain the criteria and decision rules.

Researchers should also identify important limitations, including underrepresented groups or unresolved disagreements.

The COS-STAR reporting guideline provides recommendations for reporting studies developing core outcome sets.

Transparent reporting allows readers to evaluate the credibility and inclusiveness of the prioritization process.

It also prevents unsupported claims that an outcome set represents all stakeholders when the evidence supports a narrower conclusion.

Use a Stakeholder-Informed Outcome Selection Matrix

The matrix illustrates possible stakeholder interests rather than findings from an actual consultation.

Researchers should investigate relevant priorities empirically rather than assume that every member of a stakeholder group shares the same preferences.

Using Stakeholder Input to Select Outcomes for an AI-Assisted Learning Intervention

Comparing Stakeholder Perspectives

Developing the Final Outcome Strategy

The resulting outcome set reflects several perspectives without assuming that every stakeholder priority must become a primary endpoint.

It also avoids treating platform activity as a complete substitute for meaningful learning.

The example demonstrates how stakeholder engagement can strengthen outcome relevance while leaving measurement validity and statistical planning as separate responsibilities.

Common Misconceptions About Stakeholder-Informed Outcomes

Integrate Stakeholder Priorities Without Abandoning Scientific Judgment

Identify the people and groups affected by the research and determine whether their perspectives could materially improve outcome relevance.

Then use an engagement approach appropriate to the study's purpose and resources.

Stakeholder-informed outcome selection should influence the protocol before the measurement plan is finalized whenever feasible.

The objective is not to transfer every methodological decision to stakeholders. It is to ensure that the study's scientific conclusions address consequences that matter to the people and institutions affected.

Before Finalizing Stakeholder-Informed Research Outcomes

Frequently Asked Questions About Stakeholder-Important Outcomes

Outcome Selection Should Reflect the People Affected by the Research

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.