Is There Any Unresolved Issue Serious Enough That You Should Not Move to Study Design Yet?

Is There Anything You Still Need to Resolve Before You Start Designing the Study?

You have examined the research problem, gap, question, expected contribution, feasibility, participant burden, alternative designs, existing evidence, critical assumptions, and what happens under less favorable results.

Now there is a temptation to move forward.

Choose the design. Calculate the sample. Select the instruments. Draft the interview guide. Build the experiment. Prepare the ethics application.

Before doing that, ask one final diagnostic question: is there any unresolved issue serious enough that detailed study design would be premature?

Perhaps the research question is still shifting. The main construct remains poorly defined. You do not know whether the necessary data can be accessed. A literature search has raised doubts about the claimed gap. The study's contribution still depends entirely on a positive result. Or a serious ethical concern has not been resolved.

If a foundational issue remains unstable, detailed methodology can create an illusion of progress while locking you more tightly into an idea that is not yet ready.

Do Not Design Around a Foundational Uncertainty That Could Still Change the Study

Which Unresolved Issues Should Stop You From Moving Forward?

Study design translates a research question into an evidence-generating strategy. That translation works only when the question and its justification are sufficiently stable.

Designing too early can produce methodological lock-in. Once researchers have selected instruments, written protocols, secured collaborators, prepared ethics applications, or programmed experiments, changing the underlying question becomes increasingly costly. Those investments can also make researchers more reluctant to reconsider the idea later.

The Research Problem Is Still Uncertain

If you cannot establish that the underlying problem exists in the form you claim, detailed design is premature.

Perhaps the evidence for the problem is anecdotal. Prevalence estimates are outdated. A widely repeated concern is based mainly on commentary rather than empirical evidence. Different sources define the problem differently.

Resolve whether the research problem is real and supported by evidence before designing an elaborate study to investigate it.

The Gap May Still Be an Artifact of the Search

If you are still discovering obvious terminology, adjacent literatures, or recent evidence that directly addresses the question, the gap has not stabilized.

Do not build a study around “no research has examined X” while simultaneously suspecting that relevant work may simply be hiding under another name.

Continue searching until you can distinguish a genuine gap from an incomplete search with reasonable confidence.

The Question Is Not Yet Clear

If different knowledgeable readers interpret the question differently, design decisions will drift.

You may not know which population matters, what a central construct means, whether the question concerns association or causation, which outcome is primary, or what comparison is relevant.

Detailed methods cannot compensate for a question whose intended answer is still ambiguous.

You Do Not Know What Evidence Would Answer the Question

This is one of the clearest reasons not to move forward.

Before selecting methods, you should be able to describe the kind of evidence that would bear on the question. That does not mean knowing every procedural detail. It means understanding what would count as an informative answer.

If you cannot distinguish evidence that would answer the question from evidence merely related to the topic, return to the conceptual work.

The Intended Inference Exceeds What Any Realistic Design Can Support

Perhaps the question asks whether X causes Y, but no ethically and practically available design can separate the relevant causal explanations. Or the question concerns a long-term outcome that cannot be observed within available data or time.

The solution is not to select the nearest feasible method and retain the stronger question.

Reformulate the question or identify another evidentiary pathway first.

The Expected Contribution Is Still “Nobody Has Done This Before”

If you cannot explain what becomes knowable after the study, the contribution is not ready.

Novel population, location, technology, method, or variable combination can establish difference without establishing value.

Before design, clarify whether the expected contribution is distinct enough to justify another study.

You Cannot Explain Why More Knowledge Would Matter

Suppose the question is clear and answerable. Would knowing the answer change anything?

If every plausible result leads to essentially the same scientific interpretation or practical decision, the informational value may be limited.

Do not invest heavily in methodology until you can explain what consequential uncertainty the study is intended to reduce.

Existing Evidence May Already Be Sufficient

If a recent synthesis or several strong studies appear to answer the question adequately, resolve that issue before collecting more data.

The existence of residual uncertainty is not enough. Ask whether existing evidence already answers enough of the question for the purpose that matters.

Participant Access Is Still Speculative

“We should be able to recruit students” is not the same as having a credible recruitment pathway.

If the design depends critically on a population controlled by institutional gatekeepers, a rare group, repeated follow-up, or uncertain recruitment rates, resolve enough of that uncertainty to know whether the proposed evidence can realistically be generated.

Some uncertainty may appropriately be investigated through feasibility work rather than a definitive study.

Critical Data Access Is Unverified

If the project depends on a dataset you have not inspected or permissions you have not realistically assessed, detailed design may be premature.

A database can exist without containing the required variables. The fields may be incomplete, definitions may have changed, or linkage may not be possible.

Verify the data assumptions that could fundamentally change the study.

The Timeline Works Only Under Ideal Conditions

A project that fits only if approvals arrive immediately, recruitment proceeds perfectly, no participants drop out, and analysis requires no troubleshooting is not yet operationally stable.

You do not need to predict every delay. You should know whether the project survives reasonable ones.

Required Expertise Has No Credible Source

If the design requires a method that nobody on the team can execute or interpret and there is no realistic training or collaboration plan, that gap should be resolved before the method becomes central to the protocol.

Specialist involvement can also affect measurement, sampling, data structure, and design choices, so bringing expertise in after data collection may be too late.

Essential Resources Are Still Hypothetical

A study that depends on funding not yet obtained, equipment not confirmed, software without a license, or facilities whose availability is unknown may be conditionally feasible.

Conditional feasibility is not necessarily a reason to stop all planning. It is a reason not to make irreversible commitments that assume the condition has already been satisfied.

An Ethical Concern Could Fundamentally Change the Design

Some ethical questions can be addressed during detailed protocol development. Others challenge the study more fundamentally.

Perhaps the required information is unusually sensitive, recruitment occurs within dependent relationships, participant burden is substantial, or the design exposes participants to risks difficult to justify given the expected knowledge.

Resolve whether an ethically acceptable evidentiary pathway exists before optimizing the logistics of an unacceptable one.

The Study Depends on One Untested Critical Assumption

Perhaps everything works only if an administrative field accurately represents the outcome, participants actually use the intervention, schools permit recruitment, or attrition remains below a certain level.

If failure of that assumption would invalidate the study, test it where possible before building the entire protocol around it.

This is why identifying the critical assumptions most likely to make the study fail belongs before final design.

You Have Not Seriously Compared Alternative Studies

Detailed design can create attachment to the first methodology considered.

Before committing, generate at least one serious alternative. Could another study provide stronger evidence, reduce participant burden, use existing data, finish sooner, or distinguish the competing explanations more directly?

If you have never asked the question, you do not yet know whether the current design deserves to become the study.

The Study's Value Depends Entirely on a Favorable Result

If an unsupported hypothesis would make the project feel pointless, clarify the contribution before proceeding.

The study should ideally address uncertainty rather than function as a mechanism for producing one preferred result. Ask what would be learned if the effect is smaller, absent under the tested conditions, or less decisive than expected.

Not Every Unresolved Issue Should Stop Design

This distinction is crucial.

You will never know the result before conducting the study. You may not know the exact recruitment rate, precise effect size, final pattern of missingness, or every analytical complication.

Those are ordinary research uncertainties.

The first gives you a reason to conduct research. The second may give you a reason to wait.

Resolve the Issue at the Cheapest Stage Possible

A literature search is cheaper than redesigning after recruitment. A data audit is cheaper than discovering after analysis that the required variable does not exist. A small recruitment test is cheaper than launching a multi-site study based on unrealistic enrollment assumptions.

Early-stage uncertainty is valuable when it tells you what to verify before the stakes increase.

Use a Readiness Gate Rather Than Endless Refinement

Researchers can also become trapped in perpetual planning. Another article can always be read. Another scenario can always be imagined.

The objective is not certainty. Establish explicit readiness criteria.

For example: the problem is supported, the consequential gap is sufficiently established, the question is clear, the evidence pathway is credible, major feasibility dependencies have plausible solutions, ethical concerns have a defensible pathway, and the study retains value across realistic outcomes.

Once those conditions are sufficiently satisfied, moving to detailed design becomes reasonable.

When the Study Looks Ready Until One Foundational Assumption Is Examined

The project was not waiting for a better regression model. It was waiting for a defensible connection between the question and the evidence.

What Can Make a Research Idea Look Ready Before It Actually Is?

Use a Final Readiness Gate Before Detailed Design

List every issue about the research idea that still makes you uncertain. Then ask whether resolving it could materially change the question, contribution, evidence, feasibility, ethics, or decision to proceed.

If yes, resolve it first.

Reaching this point does not imply that the study must proceed unchanged. It means the idea is sufficiently mature for a final decision among the available paths: proceed, narrow, redesign, postpone, or abandon.

Is Anything Important Still Unresolved?

Questions About Research Readiness Before Study Design

Resolve the Uncertainties About the Study Before Studying the Uncertainty

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.