Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

What Is Outcome Switching, and Why Is It a Problem?

Outcome switching occurs when prespecified research outcomes are changed, introduced, omitted, or reclassified after a study begins. Changes can be legitimate, but undisclosed result-driven switching can seriously distort the evidence.

488
What Is Outcome Switching? Guide 488 of 530
01 · The Question

If a Study Measures Several Outcomes, Can Researchers Change Which One Matters Most?

A study begins with one outcome designated as primary. After data are collected, that outcome shows little evidence of an effect, but a secondary measure produces a striking result. The published paper then emphasizes the successful measure as the primary outcome.

That is the kind of situation that raises concern about outcome switching.

Yet research protocols sometimes need legitimate amendments. Outcomes can become impossible to measure, new evidence may change what is clinically or scientifically meaningful, or unforeseen circumstances may require a different assessment. The issue is therefore not simply whether an outcome ever changed. It is what changed, when, why, whether the researchers knew the emerging results, and whether the change was transparently reported.

02 · The Short Answer

Outcome Switching Changes the Outcomes a Study Appears to Have Planned

In Brief

Outcome switching occurs when prespecified outcomes are changed, introduced, omitted, or reclassified during or after a study, particularly when the final report differs from the protocol, registration, or original analysis plan.

An outcome change is not automatically improper. The serious concern is undisclosed or result-driven switching, especially when an unfavorable prespecified primary outcome is demoted or omitted while a favorable secondary or newly introduced outcome is promoted, because this can give readers a biased impression of what the study was designed to test.

03 · What You Need to Know

How Outcome Switching Changes the Meaning of Research Findings

The Primary Outcome Is Supposed to Be Identified in Advance

Many studies collect several outcomes, but they do not necessarily have equal status. In randomized trials, the primary outcome is the prespecified outcome considered most important for evaluating the intervention and is commonly linked to the study objective and sample-size calculation. Other prespecified outcomes may be secondary.

Current SPIRIT and CONSORT guidance requires primary and secondary outcomes to be clearly defined, including the measurement variable, analysis metric, method of aggregation, and relevant time point.

This specificity matters. Saying “depression” is not necessarily a complete outcome definition if researchers could later choose among several scales, scoring methods, or time points. Each additional degree of freedom can create another opportunity to favor the version producing the most attractive result.

Outcome Switching Can Take Several Forms

Change Illustrative example Why it matters
Primary outcome is demoted The original primary outcome becomes secondary in the publication The main planned test receives less emphasis after its result is known
Secondary outcome is promoted A favorable secondary outcome becomes the reported primary outcome The study may appear to have succeeded on its main objective when that was not the original test
Prespecified outcome is omitted An unfavorable planned outcome disappears from the publication Readers cannot see part of the evidence the study intended to collect
New outcome is introduced An unplanned measure becomes a major reported endpoint A post hoc finding may appear prespecified
Measurement time point changes The protocol specifies six months, but the paper emphasizes three months Different time points can produce different conclusions
Outcome definition changes A continuous scale is replaced by a favorable threshold-based definition The operational definition itself may be selected after results are known

Not every discrepancy necessarily represents deliberate manipulation. Some may result from legitimate protocol amendments, reporting errors, or practical problems. That is precisely why researchers should explain changes rather than leave readers to guess.

Why Switching the Primary Outcome Is Especially Consequential

Imagine a trial with one prespecified primary outcome and eight secondary outcomes. The primary result is nonsignificant, while one secondary outcome produces p =.02.

If the paper simply reports the secondary finding as the primary endpoint, the evidential history has changed. Readers may reasonably assume that this was the main outcome selected before results were available and that the study's design and inferential strategy were built around it.

They are no longer seeing the same research question the study originally set out to answer.

CONSORT notes that having multiple outcomes creates problems involving multiplicity and selective reporting, and it recommends consistency between reported primary and secondary outcomes and those prespecified in protocols and registries. Changes should be identified and explained.

Outcome Switching Is Closely Related to Selective Outcome Reporting

The concepts overlap but are useful to distinguish.

Outcome switching Changes the identity, definition, timing, or status of outcomes relative to what was prespecified.
Selective outcome reporting Reports outcomes selectively so that the published account does not adequately represent the outcomes measured or planned.

If a prespecified primary outcome is silently omitted and a favorable secondary outcome is promoted, both problems may occur. The outcome has been switched, and the resulting report selectively presents the evidence.

The broader issue of selective outcome reporting therefore extends beyond merely changing which outcome carries the “primary” label.

Outcome Switching Can Favor Statistically Significant Findings

This concern is not merely hypothetical. CONSORT's evidence review notes discrepancies between outcomes reported in protocols or registries and those appearing in final publications, with discrepancies frequently favoring statistically significant outcomes.

CONSORT also cites empirical work in which protocol-publication comparisons identified primary outcomes that had been changed, introduced, or omitted, often without those changes being explained in the published reports.

The implication should be interpreted carefully. A discrepancy does not by itself prove that researchers deliberately changed an outcome to obtain a publishable result. But systematic changes favoring statistically significant findings can distort the published evidence base.

Changing an Outcome Is Not Automatically Wrong

Research occurs in the real world, where circumstances change.

A measurement instrument may become unavailable. New external evidence may show that the originally selected time point is unsuitable. Recruitment or event rates may differ substantially from assumptions. A better-validated measure may become necessary. Formal adaptive designs may also allow prospectively specified modifications.

CONSORT explicitly recognizes that outcome changes can sometimes be necessary. Its recommendation is not “never change an outcome.” Instead, important changes after a trial begins, including outcomes that were not prespecified, should be reported together with the reasons for those changes. Changes made using unblinded outcome data are substantially more concerning.

The timing and information available at the time of the decision therefore matter enormously.

Changing an Outcome Before Knowing the Results Is Different From Changing It Afterward

Suppose investigators learn midway through a blinded trial that an external study has established a substantially better measurement instrument. They amend their protocol before examining outcome differences between groups, document the change, update relevant records, and explain it in the final report.

Now compare that with investigators who examine the group results, discover that the primary outcome is unfavorable, and then promote a favorable secondary endpoint.

Both studies changed an outcome. Their risks of bias are very different.

This is why the question of whether you can change a primary outcome after data collection begins cannot be answered simply by saying yes or no. What information was available when the decision was made is central.

Registries and Protocols Make Outcome Switching Detectable

If the only public record is the final paper, readers may have no way to know that an outcome changed.

Prospective protocols, trial registrations, and statistical analysis plans create records of what researchers intended before the results were known. CONSORT notes that access to the protocol provides context for interpretation and can help constrain undeclared post hoc methodological changes and selective outcome reporting.

These records do not prevent every problematic change. Their value is partly forensic: they allow readers, reviewers, editors, and systematic reviewers to compare what was planned with what was eventually reported.

Watch Out

Simply updating a registry after results are known does not make an outcome retrospectively prespecified. When an outcome changes, preserve the chronology. Readers need to know what was planned originally, what changed, when it changed, and why.

04 · A Practical Example

When a Secondary Outcome Quietly Becomes the Main Result

Hypothetical Example

A Trial of a Stress-Reduction Program

A randomized trial prespecifies perceived stress at 12 weeks as its primary outcome. Sleep quality, anxiety, wellbeing, and program satisfaction are secondary outcomes.

Primary outcome The difference in perceived stress at 12 weeks is small and not statistically significant.
Secondary outcomes Most secondary outcomes are also inconclusive, but sleep quality shows a statistically significant difference favoring the intervention.
The switch The manuscript identifies sleep quality as the primary outcome and gives perceived stress little attention. The change from the registered protocol is not mentioned.
The impression A reader who sees only the paper may reasonably conclude that the study was designed primarily to test whether the program improves sleep and that its primary hypothesis was supported.

The sleep result itself has not become false merely because it was originally secondary. It may be scientifically interesting.

The problem is that its evidential status has been rewritten. The publication makes a secondary finding appear to be the study's prespecified main test while obscuring the unsuccessful primary outcome.

A transparent paper could instead report that the prespecified primary outcome did not provide clear evidence of an effect, present the sleep finding with its correct original status, discuss relevant multiplicity, and explain any legitimate changes to the protocol.

05 · What Researchers Often Get Wrong

Common Misunderstandings About Outcome Switching

Misconception

You Can Never Change a Primary Outcome

Outcome changes can sometimes be scientifically or operationally justified. CONSORT explicitly accommodates important protocol changes but requires them to be reported and explained. The timing of the change and whether investigators had access to outcome results are important considerations.

Misconception

A Secondary Outcome Is Unimportant

Secondary outcomes can answer valuable research questions and sometimes reveal important effects. Calling an outcome secondary describes its prespecified role in the study, not whether its finding is intellectually interesting. The problem is retrospectively changing its status without appropriate disclosure.

Misconception

If the New Outcome Is More Clinically Meaningful, No Explanation Is Necessary

A better rationale does not erase the chronology. If scientific developments justify changing an outcome, explain that rationale and when the decision occurred. Readers can then assess the amendment rather than being given a reconstructed protocol.

Misconception

Outcome Switching Only Means Replacing One Variable With Another

Outcome discrepancies can also involve promoting or demoting outcomes, changing measurement time points, altering analysis metrics, introducing outcomes, or omitting prespecified outcomes. Complete outcome definitions matter because seemingly small changes can alter the question being tested.

Misconception

If the Outcome Change Is Mentioned Somewhere, the Problem Is Completely Solved

Disclosure is essential, but it does not automatically remove bias introduced by a result-driven change. Readers still need to interpret the finding according to when and why the outcome changed, and the statistical analysis may need to address multiplicity or other consequences.

06 · What This Means for You

What to Do If an Outcome Really Needs to Change

The safest approach is not to treat the original protocol as immutable. It is to preserve the history of the study.

A simple decision framework

If the change is proposed before relevant outcome data are available
Document the rationale, timing, and amendment through the appropriate protocol, registry, ethics, or governance procedures for your study.
If the outcome must change for a methodological or practical reason
Explain why the original outcome is no longer appropriate or feasible and preserve the original specification in the study record.
If you have already examined the outcome results
Treat a proposed switch with much greater caution and make the data-dependent timing explicit rather than presenting the replacement as prespecified.
If an unexpected secondary outcome is compelling
Report and interpret it in its actual prespecified or exploratory status instead of silently promoting it to primary.
If the final report differs from the protocol or registry
Identify the consequential differences and explain why they occurred.

For randomized trials, CONSORT 2025 specifically requires important changes after commencement, including outcomes or analyses that were not prespecified, to be reported with reasons. Results should also be reported for planned primary and secondary outcomes rather than only those that are statistically significant or interesting.

Requirements differ across study designs, disciplines, registries, journals, and funders, so researchers should also verify the standards that apply to their own work.

07 · A Quick Checklist

Before Changing or Reporting an Outcome

If an outcome has changed, check:
Was the original primary outcome clearly specified in the protocol, registration, or analysis plan?
What exactly changed: the outcome, its primary or secondary status, measurement instrument, analysis metric, or time point?
When was the decision made relative to data collection and access to outcome results?
Was the change motivated by external scientific or methodological information rather than by a favorable observed result?
Have the original outcome and the amendment both been preserved in the research record?
Have applicable registry, protocol, ethics, funder, or governance records been updated appropriately?
Does the final manuscript explicitly disclose and explain consequential outcome changes?
Are planned outcomes reported even when their results are nonsignificant or less interesting?
08 · Frequently Asked Questions

Frequently Asked Questions About Outcome Switching

Is changing the primary outcome always research misconduct?

No. Legitimate circumstances can require protocol amendments, and classifications of misconduct depend on applicable institutional and regulatory definitions. The research-integrity concern becomes especially serious when outcome changes are driven by known results and concealed from readers.

Can I promote a secondary outcome to primary?

There may be circumstances in which the designation legitimately changes, but the original status, timing, and rationale for the change should remain transparent. Silently promoting a favorable secondary result after examining the data can seriously misrepresent the study's evidential history.

Does changing the outcome measurement time count as outcome switching?

It can. An outcome includes more than the variable name. The measurement time point can materially alter the research question and result. Current SPIRIT and CONSORT guidance therefore asks researchers to specify the time point of interest as part of a complete outcome definition.

What if the original primary outcome turns out to be a poor measure?

A genuinely inadequate measure may justify an amendment. Document the methodological reason, when the problem became apparent, what information was available when the decision was made, and how the change affects interpretation. Do not rewrite the study history to make the replacement appear original.

What if my secondary outcome is much more interesting than the primary outcome?

You can discuss and report it prominently where scientifically justified, but prominence does not require changing its historical status. Readers should still know which outcome was designated primary before the results were known.

Is outcome switching the same as HARKing?

No. Outcome switching changes which outcome, endpoint, definition, or time point appears to have been planned. HARKing concerns presenting a hypothesis developed after seeing results as though it had been formulated beforehand. They can occur together, but they describe different changes to the research story.

How can readers detect outcome switching?

When available, compare the publication with prospectively dated protocols, trial registrations, statistical analysis plans, and earlier versions of study records. Differences are not automatically evidence of wrongdoing, but unexplained changes to primary outcomes deserve scrutiny.

09 · The Bottom Line

An Outcome Can Change, but the Study's History Should Not

The Bottom Line

Outcome switching becomes problematic when the outcomes presented as planned in the final research report differ from those actually prespecified, especially when known results influence the change and the discrepancy is concealed.

Legitimate outcome changes can occur. What protects the credibility of the research is preserving the chronology: document what was originally planned, what changed, when the decision was made, why it was necessary, and what information researchers had at the time. A protocol may evolve; its history should not be rewritten.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes