03 · What You Need to Know
When Registered Reports Are Appropriate and What They Require
What Makes a Registered Report Different From an Ordinary Submission?
A Registered Report is a scholarly publishing format in which a study's research questions, rationale, methods, and proposed analyses undergo peer review before the principal results are known.
In the conventional two-stage model, researchers first submit a Stage 1 manuscript. Reviewers assess the importance of the question and the methodological capacity of the proposed study to answer it.
Following successful review, the journal may grant in-principle acceptance (IPA). The researchers then complete the study and submit a Stage 2 manuscript containing the results and interpretation.
At Stage 2, the journal evaluates whether the approved procedures were followed, whether departures were justified, and whether the conclusions are supported by the evidence. Publication is not supposed to depend on obtaining a favorable result, although the journal's specific conditions still apply.
This differs from ordinary preregistration, which creates a prospective research record without necessarily involving journal peer review or a publication commitment. The distinction is examined in preregistration versus Registered Reports.
When Is a Study Ready for Stage 1 Submission?
A study is a plausible candidate for Stage 1 submission when its central research question is sufficiently developed and its principal methodological decisions can be evaluated before the main results are obtained.
The manuscript should ordinarily establish the theoretical rationale, hypotheses or research objectives, design, sampling strategy, measurement procedures, analysis plan, and relevant feasibility considerations.
Researchers do not necessarily need to have finalized every administrative detail. However, the proposal must be developed enough for reviewers to judge whether the study is capable of producing informative evidence.
For confirmatory quantitative research, this commonly includes a defensible sample-size justification, prespecified outcomes, planned analyses, and appropriate procedures for managing missing or invalid data.
For other methodologies, the necessary commitments may differ. The decisive consideration is whether the proposed procedures can be evaluated meaningfully before the main findings become available.
Should You Submit Before Collecting Any Data?
Submitting before beginning the principal data collection is often the clearest approach. It allows peer review to influence the design while reducing concerns that observed results have shaped the proposed hypotheses or analyses.
However, some journals permit Stage 1 submissions involving pilot data, existing datasets, or studies at particular stages of data collection. The relevant requirements vary.
For secondary-data studies, a central consideration is whether researchers have already accessed or examined the outcome information relevant to the proposed tests. A dataset may exist without the investigators having seen the results of the planned analysis.
Researchers should disclose prior data access, preliminary analyses, and the extent to which the proposed hypotheses were informed by existing evidence.
Do not assume that a study is eligible simply because its analysis has not yet been written. Consult the target journal's current Registered Report instructions before investing substantial effort in a Stage 1 manuscript.
Which Research Situations Benefit Most From Early Peer Review?
Registered Reports may be particularly useful when design decisions are consequential, difficult to reverse, or likely to benefit from independent methodological scrutiny.
| Research situation |
Potential benefit |
Important consideration |
| Confirmatory experiment |
Review of hypotheses, assignment, measurement, and analysis before implementation. |
Requires a sufficiently developed and feasible protocol. |
| Replication study |
Evaluation of replication rationale and methodological fidelity before results are known. |
Differences from the original study must be justified. |
| Study with expensive data collection |
Opportunity to identify design weaknesses before major resources are committed. |
Stage 1 review may delay implementation. |
| Study addressing a contested finding |
Results-independent assessment of the question and planned test. |
The design must distinguish competing explanations adequately. |
| Secondary-data confirmatory analysis |
Prospective scrutiny of planned analyses when relevant results remain unknown. |
Journal eligibility and prior data access require careful disclosure. |
| Qualitative or mixed-methods study |
Early evaluation of methodological coherence and intended analytic procedures. |
The journal must support the methodology and appropriate flexibility. |
These are potential benefits rather than guarantees. Early peer review is only as useful as the expertise of reviewers, the quality of the proposed design, and the researchers' ability to implement appropriate feedback.
Why Are Registered Reports Especially Relevant to Confirmatory Research?
Confirmatory research seeks to evaluate hypotheses or predictions specified before the relevant evidence is examined. Its credibility may be weakened when researchers can modify outcomes, analyses, or reporting decisions after observing results without disclosing those changes.
Registered Reports address part of this problem by evaluating the proposed study before the main findings are known.
They also seek to reduce publication bias arising when statistically significant or otherwise favorable results have a greater chance of publication than informative null or unexpected findings.
Under the conventional model, in-principle acceptance is based on the importance of the question and the quality of the methods rather than the direction or statistical significance of the eventual results.
This makes the format particularly relevant when a study's value should depend on the strength of its design rather than whether its hypotheses are supported.
Does a Registered Report Require a Fixed Hypothesis?
Not universally. The appropriate requirements depend on the journal and the research methodology.
Many Registered Reports are confirmatory studies with explicitly stated hypotheses. However, the format has also been extended to research approaches that do not rely on conventional directional hypothesis testing.
For qualitative research, the Stage 1 manuscript may emphasize research questions, methodological orientation, sampling logic, data generation procedures, analytic commitments, and plans for documenting justified adaptations.
Mixed-methods studies may need to explain how findings from one component will inform subsequent phases.
Researchers should not invent fixed hypotheses merely to make an exploratory study resemble an experiment. The more important question is whether the target journal can evaluate the proposed methodology on its own terms.
The practical issues surrounding qualitative and mixed-methods Registered Reports require particular attention to this methodological fit.
What Do Reviewers Need to Evaluate at Stage 1?
Stage 1 reviewers ordinarily examine whether the research question is meaningful and whether the proposed methods can answer it convincingly.
Depending on the study, this may involve assessing the theoretical rationale, design validity, measurement quality, sampling, statistical power or precision, planned analyses, and feasibility.
Reviewers may also consider whether the proposed tests can distinguish among competing explanations and whether the interpretation plan is consistent with the intended evidence.
The detailed criteria are explained through Stage 1 peer review of Registered Reports.
For researchers, the practical implication is that a Stage 1 manuscript must be more than a promising research idea. It should contain enough methodological detail to support a substantive evaluation.
How Does In-Principle Acceptance Affect Publication?
In-principle acceptance provides a conditional publication commitment under the journal's Registered Report procedures.
It does not mean that the study has already been completed successfully or that the final manuscript will be published regardless of its quality.
Researchers are generally expected to conduct the approved study, disclose and justify consequential deviations, report the planned analyses, and interpret the findings appropriately.
Stage 2 review may identify serious departures, implementation problems, or unsupported conclusions. Journals differ in how they handle these circumstances.
The limits of the commitment are important when evaluating whether in-principle acceptance guarantees publication.
Can Registered Reports Publish Null or Unexpected Results?
Yes. One of the format's defining objectives is to make publication decisions less dependent on whether the results support the original hypotheses.
A well-conducted study may produce a null result, an effect in the opposite direction from that predicted, or an unexpected pattern. These findings can remain informative when the design and analysis support the relevant interpretation.
However, a statistically nonsignificant result does not automatically establish that no effect exists. The estimate, uncertainty, design sensitivity, and assumptions still matter.
The treatment of null and unexpected findings in Registered Reports is therefore an important consideration when selecting the format.
Can You Include Exploratory Analyses?
Yes. Registered Reports can include additional exploratory investigations, subject to the journal's policies and transparent reporting requirements.
The key distinction is between analyses approved prospectively and those developed after examining the results.
Exploratory analyses may reveal unexpected relationships or generate hypotheses for subsequent research. Their inclusion does not necessarily undermine the Registered Report, provided their status is accurately described.
Researchers should avoid using exploratory findings to retrospectively redefine the study's original confirmatory objectives.
What If Your Study Design Must Change After Acceptance?
Research rarely proceeds exactly as planned. Recruitment difficulties, measurement problems, ethical concerns, or unexpected technical limitations may require changes to the approved protocol.
Registered Reports generally permit justified amendments, but consequential changes may require consultation with the handling editor or additional review.
Researchers should preserve the approved plan, document the reasons and timing of changes, and explain their implications for the original research questions.
Because journal policies differ, the appropriate procedure should be confirmed before implementing major revisions. The considerations surrounding design changes after Stage 1 acceptance are particularly relevant.
When Might a Registered Report Be a Poor Fit?
The format may be less suitable when the principal research decisions cannot reasonably be established before the evidence becomes available or when early review would not meaningfully improve the study.
Potential difficulties include:
- A study already completed before the relevant journal's permitted submission stage.
- An exploratory project whose central purpose requires substantial unanticipated changes to its research questions or methods.
- A time-sensitive project that cannot accommodate the expected Stage 1 review period.
- A research design whose feasibility remains too uncertain for reviewers to evaluate responsibly.
- A project for which no suitable journal currently offers an appropriate Registered Report route.
These circumstances do not necessarily make the research less rigorous. They may simply indicate that another publication format is more appropriate.
Researchers can still use preregistration, transparent protocols, open materials where ethically permissible, and careful reporting of methodological decisions.
How Should You Choose a Journal for a Registered Report?
Begin with disciplinary fit and the journal's ability to evaluate the proposed research. The availability of a Registered Report option is important, but it should not outweigh the relevance of the journal's scope and readership.
Check the journal's official instructions for Stage 1 eligibility, accepted methodologies, prior data collection, required manuscript sections, review procedures, and conditions for in-principle acceptance.
Also examine publication charges, open-access options, data-sharing requirements, and any special arrangements for studies involving confidential or sensitive information.
Registered Report policies can change. The Center for Open Science maintains resources concerning participating journals, but the target journal's current author instructions should be treated as the authoritative source for its submission requirements.
Journal indexing, citation metrics, and prestige should not substitute for evaluating methodological fit, editorial quality, and the actual conditions of publication.
