When Should You Refuse to Study a Question Mainly Because It Is Easy to Publish?

What If a Question Looks Attractive Mainly Because You Think Journals Will Want It?

Researchers cannot completely ignore publication. Papers matter for communicating findings, building cumulative knowledge, establishing scholarly records, completing degrees, competing for positions, and meeting institutional expectations. It would be rather theatrical to pretend that publication incentives never enter research decisions.

The problem begins when the order reverses. Instead of asking which important uncertainty deserves investigation and then deciding how the resulting research should be communicated, a researcher starts with what appears likely to produce a paper and works backward toward a question.

A research question does not become worth answering merely because its answer seems easy to publish. Publishability concerns the prospects for communicating a study through a particular scholarly system. Research value concerns whether conducting the study is likely to produce knowledge worth having. The two can overlap, but they are not equivalent.

Refuse the Question When Publication Prospects Are Carrying the Research Rationale

Publishability and Research Value Answer Different Questions

A researcher considering a project is really making at least two decisions. First: should this research be conducted? Second: if it is conducted well, where and how should the findings be communicated?

Problems arise when the second decision quietly determines the first.

A project can score highly on one and poorly on the other. Important replications, null findings, methodological corrections, negative results, or careful confirmatory studies may face different publication prospects from fashionable or surprising findings. Conversely, a technically novel combination of familiar variables may fit a journal's scope without substantially changing what the field knows.

Ask whether you would still conduct the study if publication were guaranteed to be impossible

This is intentionally a demanding thought experiment.

Imagine that the findings could still be shared with the people who need them, incorporated into a thesis, deposited transparently, or used for the relevant decision, but no journal article could result. Would the answer still be worth obtaining?

If yes, you probably have a justification independent of publication. If the entire motivation disappears, examine what intellectual or practical purpose the project was serving in the first place.

This does not mean researchers should disregard career realities. Early-career researchers in particular work under genuine publication expectations. The point is narrower: those incentives explain why a project may be attractive to the researcher. They do not establish why the answer is valuable as research.

“Publishable novelty” can be manufactured without producing much knowledge

It is usually possible to make a study look different from earlier work.

Add a variable. Replace one technology with a newer platform. Survey another university. Change the population. Add a mediator. Test another moderator. Apply a familiar model in another country.

Any of these modifications can be valuable when it addresses a real uncertainty. But if its principal purpose is to create a sentence beginning “Unlike previous studies, this research...,” the contribution may be more bibliographic than substantive.

The question should survive the test of whether the additional variable actually produces insight, whether the population matters, or whether the contextual change affects what can be inferred.

Journal interest does not establish importance

Journals make editorial decisions for many legitimate reasons, including scope, readership, novelty, methodological contribution, timeliness, available space, and perceived interest. These criteria are related to research value but are not identical to it.

One useful illustration comes from research-funding review. NIH's current simplified peer-review framework explicitly separates the importance of the proposed research from rigor and feasibility. Reviewers assessing importance consider whether the project addresses an important knowledge gap, critical problem, or valuable conceptual or technical advance, and what specifically will be learned. NIH further cautions that importance refers to the proposed research itself rather than merely the importance of the broader field.

The principle translates well beyond biomedical grant review: a study should be able to explain what it contributes without borrowing importance from its topic, journal prospects, or surrounding academic attention.

Easy publication can tempt researchers toward questions with predictable answers

Researchers may gravitate toward designs with familiar instruments, established models, convenient samples, straightforward statistical analyses, and hypotheses that prior studies make likely to receive support.

None of those features is inherently problematic. Familiar methods can be excellent methods. Predictable findings can also be valuable when confirmation itself matters.

The concern arises when methodological convenience and anticipated manuscript structure replace informational value. If the study is essentially designed to generate several plausible hypotheses, a conventional results table, and a familiar discussion section, ask what uncertainty the resulting paper would actually reduce.

Do not design the question around statistical significance

A particularly damaging version of publication-oriented thinking occurs when researchers prefer questions likely to produce statistically significant findings.

Statistical significance does not establish that a question was important, an effect was large, an explanation was correct, or the study contributed useful knowledge. Designing a project around the likelihood of obtaining conventionally significant results can also encourage selective analytical choices and overinterpretation.

A useful research question should remain useful if the answer is “no association,” “no meaningful difference,” or “the estimate remains uncertain,” provided the study was designed so those outcomes are genuinely informative.

A study should be publishable because it is worth communicating, not worthwhile because it is publishable

This reversal sounds subtle, but it changes how research is designed.

When the question comes first, researchers identify consequential uncertainty and choose methods capable of resolving it. They then seek an appropriate outlet for whatever answer emerges.

When the anticipated paper comes first, researchers can begin optimizing the project for editorial appearance: a fashionable topic, a novel-looking model, positive hypotheses, a convenient dataset, and enough differences from prior work to claim novelty.

The resulting study may still be rigorous. It may even be published. But successful execution and successful publication do not by themselves establish that the original question deserved the research investment.

Publication incentives become especially problematic when they distort the question

A useful diagnostic is to compare the question you most want answered with the question you believe will be easiest to publish.

If they differ, ask why.

Perhaps the important question requires data you cannot obtain. Perhaps the publishable question is more feasible. Those are legitimate constraints. But perhaps the second question is simply fashionable, statistically convenient, or easy to package. In that case, publication incentives may be redirecting the research agenda away from the uncertainty that matters most.

The answer is not necessarily to conduct the difficult project immediately. If the important question cannot yet be answered reliably, it may be better to save it for a stronger future study than replace it automatically with a weaker question that happens to promise a faster paper.

When the Manuscript Idea Arrives Before the Research Problem

The issue is not that secondary analysis or fashionable variables are illegitimate. The problem is allowing anticipated editorial appeal to substitute for the missing inferential reason.

Common Ways Publication Incentives Distort Research Choices

Choose the Question First and the Publication Strategy Second

Before committing to a project, write two separate rationales. The first should explain why the answer is worth knowing. The second can explain why the resulting research might interest a particular scholarly audience.

If you cannot write the first without relying on the second, the project needs reconsideration.

The same discipline is useful when a topic is attractive mainly because it is fashionable. Trends and journals can help determine where research receives attention. They should not determine, by themselves, which uncertainties deserve evidence.

Check Whether the Research Question Exists Independently of the Paper

Questions About Publishability and Research Value

A Paper Is a Way to Communicate Research, Not a Reason to Conduct It

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.