Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Which Strengths in Previous Studies Should Your Study Preserve?

Improving on previous research does not mean changing everything. Learn how to identify the conceptual, methodological, measurement, and reporting strengths worth carrying forward into your own study.

873
Preserving Strengths From Previous Studies Guide 873 of 899
01 · The Question

What Did Previous Researchers Already Get Right?

Once you begin identifying weaknesses in previous studies, redesign can become strangely addictive.

You want a different population, a better measure, a stronger comparator, a longer follow-up, and perhaps an entirely new analytical strategy. Before long, almost nothing from the previous research remains.

That may occasionally be justified. More often, it overlooks an equally important lesson from the literature: some decisions in previous studies worked well and should be preserved.

A well-defined construct, an appropriate comparison, a validated measurement procedure, a thoughtful recruitment strategy, a transparent analytical approach, or a design feature that directly isolates the phenomenon of interest may provide a strong foundation for the next study. Changing those features merely to make your project look different can sacrifice comparability, validity, or accumulated methodological knowledge without producing a genuine improvement.

02 · The Short Answer

Preserve What Is Defensible and Still Fits Your Question

In Brief

Your study should preserve strengths from previous research when those features are well justified, relevant to your research question and population, supported by appropriate evidence, and useful for producing valid, interpretable, comparable, or transparent findings.

Do not confuse improvement with methodological novelty. A new study can address weaknesses while deliberately retaining features that previous research handled well. The aim is to improve the evidence, not to make every element of the study different from what came before.

03 · What You Need to Know

Good Research Design Is Cumulative Too

The Literature Contains Solutions as Well as Problems

Previous studies can show you where evidence repeatedly breaks down, but they can also show you which choices have produced coherent, credible, and useful research.

Perhaps several studies define a difficult construct particularly clearly. One research team may have developed a measurement procedure with strong evidence for the intended interpretation. Another study may use a comparison condition that isolates the mechanism you care about. A longitudinal design may reveal the time scale on which an outcome becomes meaningful. A qualitative study may demonstrate a particularly transparent approach to sampling, reflexivity, or analytic documentation.

These are not merely details to describe in a literature review. They can become design resources.

Replication of a feature Retaining a previous methodological or conceptual choice because it remains appropriate and useful.
Uncritical imitation Copying a previous choice because it is familiar or common without checking whether its rationale applies to the new study.

The difference is justification. You preserve a strength because you understand why it is strong for your purpose.

Preserve Clear Conceptual Definitions

One of the easiest strengths to lose during redesign is conceptual clarity.

If previous research has carefully distinguished related constructs, established terminology that permits studies to communicate with one another, or developed a useful conceptual framework, do not abandon that clarity merely to introduce a new label.

Conceptual novelty is valuable when existing concepts are genuinely inadequate. Renaming an established construct without changing its meaning can instead fragment the literature and make cumulative interpretation harder.

At the same time, do not preserve a definition merely because it is dominant. Your earlier review of the assumptions underlying the study may reveal that the conventional definition rests on a questionable premise. Preservation should follow evaluation.

Preserve Measures When the Evidence Supports Their Intended Use

Researchers sometimes assume that a new study becomes more original if it creates a new questionnaire or modifies an existing scale.

Usually, instrument novelty is not a virtue by itself.

If an existing measurement instrument adequately represents the construct you need, has appropriate evidence for its intended interpretation and population, is feasible to administer, and permits meaningful comparison with earlier research, preserving it may be preferable to creating a new measure.

COSMIN guidance for outcome measurement emphasizes defining the outcome first and then evaluating candidate instruments according to their measurement properties and feasibility. The same general logic is useful beyond health measurement: preserve an existing measure because the evidence supports its use, not because previous researchers happened to use it.

Conversely, if the literature shows that the measure is poorly aligned with your outcome, preserving comparability would merely preserve the same problem. Your decision about what the study actually needs to measure takes priority.

Comparability Can Be a Scientific Strength

Using some of the same definitions, outcomes, measures, time points, or analytical conventions as previous high-quality research can allow findings to be compared more directly.

That matters because knowledge accumulates across studies. If every researcher measures the same phenomenon in an entirely different way, it becomes harder to determine whether apparently different findings reflect genuine differences or incompatible methods.

This is one rationale behind initiatives such as core outcome sets in clinical research, which seek agreement on minimum outcomes that should be measured and reported for particular conditions or areas. Standardization is not appropriate everywhere, and it should not prevent researchers from adding outcomes required by their own questions. Still, unnecessary methodological variation can impede synthesis.

Preserving comparability is therefore a legitimate design consideration. It should not, however, become an excuse for retaining a method known to be weak.

Preserve Design Features That Control Important Alternative Explanations

Sometimes a previous study contains an elegant solution to an inferential problem.

An active comparison may control for additional instructional time. Matching or stratification may address a known source of imbalance. Repeated measurement may separate baseline differences from subsequent change. Blinding may reduce particular forms of bias where it is feasible. A qualitative sampling strategy may deliberately capture perspectives necessary to understand variation in the phenomenon.

If those design features remain relevant to your question, removing them can make the new study weaker even if other aspects improve.

When reviewing previous work, therefore, ask not only what each design feature does, but what would become harder to interpret if you removed it.

Preserve Appropriate Population Boundaries

Broader inclusion is not always an improvement.

A previous study may deliberately restrict participation because the phenomenon applies to a particular career stage, diagnosis, educational level, exposure history, or other substantively defined population. If your question concerns the same population-specific process, preserving that boundary may maintain conceptual coherence.

Alternatively, the literature may reveal that the restriction unnecessarily limits applicability. In that case, changing the population you plan to study may be justified.

The strength lies in alignment between population and question, not in narrowness or breadth by itself.

Preserve Timing When It Matches the Phenomenon

A previous study's timing can be methodologically informative.

If an outcome is expected to emerge gradually, repeated or delayed measurement may be essential. If the phenomenon is an immediate response, measuring it months later may introduce an entirely different question.

When previous studies have established a defensible observation period, preserve it unless your research question specifically requires another time scale. Changing follow-up merely to be different can reduce comparability without improving the inference.

Preserve Transparent Procedures

Some of the most valuable strengths are not flashy.

A study may clearly document eligibility decisions, intervention delivery, missing-data handling, coding procedures, deviations from the protocol, analytical choices, or the distinction between planned and exploratory analyses. These practices make research easier to evaluate and build upon.

Reporting guidelines collected through the EQUATOR Network provide design-specific frameworks for reporting many forms of health research. Similar discipline-specific standards may exist elsewhere. Where an appropriate guideline applies, preserving strong reporting practice is not merely cosmetic. It helps later researchers understand what was actually done.

A transparent method also supports the kind of traceability you should expect when evidence is later synthesized.

Preserve Strengths Even When the Study's Findings Were Inconvenient

Researchers can become oddly selective about methodological admiration. A design is praised when its findings support expectations and scrutinized aggressively when they do not.

Separate methodological quality from result direction.

If a well-designed study produces a null or contradictory finding, its strengths do not disappear. Indeed, preserving those strengths may be especially important when attempting replication or investigating why findings differ.

Do not choose methods according to which previous result you would prefer to reproduce.

A Strength in One Study May Not Transfer to Yours

Even a genuinely strong methodological feature is context-dependent.

A measure validated among adults may not be suitable for children. A comparator appropriate for a clinical efficacy question may be irrelevant to an implementation question. A highly controlled laboratory procedure may be ideal for isolating a mechanism but unsuitable when the new study asks whether the phenomenon occurs under ordinary conditions.

Watch Out

Do not turn “best practice” into a context-free label. Ask what made the feature strong in the previous study and whether the same rationale applies to your question, population, setting, and intended inference.

Preservation and Improvement Can Occur in the Same Design

You rarely need to choose between copying previous research and replacing it completely.

You might preserve a well-supported outcome measure while improving the sampling strategy. You might retain a strong comparator but extend the follow-up period. You might reproduce an intervention protocol faithfully while improving documentation of implementation. You might retain an established conceptual definition while testing it in a population for which applicability remains uncertain.

This selective continuity is often what cumulative research looks like: hold defensible elements steady while changing the features responsible for an unresolved uncertainty.

04 · A Practical Example

Improving a Study Without Throwing Away What Already Works

Hypothetical Example

Extending Research on AI-Generated Formative Feedback

Imagine that several previous studies compare AI-generated formative feedback with instructor feedback on student writing. The studies use a carefully developed rubric scored by trained assessors who are unaware of students' feedback condition. However, most studies involve only one writing task and assess revision immediately.

You want to investigate whether any improvement persists across later independent writing.

Strength worth preserving The established scoring procedure closely matches the writing outcome, has a clear scoring protocol, and reduces the possibility that assessors' knowledge of condition influences ratings.
Weakness worth changing The previous design cannot show whether improvement transfers beyond the revised task.
Your design Preserve the defensible scoring procedure and assessor masking while adding a subsequent independently completed writing task at a meaningful interval.
Why this is useful The methodological continuity improves comparability with previous findings, while the changed timing addresses the uncertainty your study is intended to resolve.

The contribution does not require inventing a new writing scale, new comparison, new terminology, and new analytical framework simultaneously. In fact, holding some strong features constant can make the new evidence easier to interpret.

05 · What Researchers Often Get Wrong

Common Mistakes When Building on Strengths in Previous Research

Misconception

An Original Study Should Use Different Methods

Originality does not require methodological difference for its own sake. Reusing a defensible measure, comparison, protocol, or analytical strategy may strengthen cumulative knowledge. The contribution can arise from the question being tested, the uncertainty being reduced, or a targeted design improvement.

Misconception

If a Previous Study Has Weaknesses, Its Methods Should Be Replaced

A study can contain strong and weak features simultaneously. Identify which methodological choices caused the relevant limitation rather than discarding the entire design. Selective improvement is usually more informative than methodological demolition.

Misconception

The Most Common Method Is Automatically a Strength

Popularity establishes precedent, not quality. Preserve a common practice only when its rationale and evidence support its use for your question. A recurring weakness can become conventional too.

Misconception

Using the Same Measure Makes Your Study a Replication

Sharing one methodological feature does not make two studies equivalent. Population, question, design, exposure, comparison, timing, and analytical purpose may differ substantially. Methodological continuity can simply provide a common reference point.

Misconception

A More Sophisticated Method Is Necessarily an Improvement

Additional complexity is useful only when it addresses the research problem. Replacing a transparent, appropriate method with a more elaborate one can reduce interpretability or feasibility without improving the evidence. Complexity is a cost that needs a methodological return.

06 · What This Means for You

Make a “Preserve” List Alongside Your “Fix” List

When you review previous studies, do not record only limitations. For the strongest and most relevant studies, identify features that helped them answer their questions well.

Then ask whether those strengths remain useful for your study.

A simple decision framework

If a previous feature directly strengthens the inference you need and remains appropriate to your context
Preserve it unless there is a clear reason to change it.
If an established measure is well aligned with your construct and supported for the intended use
Consider preserving it to retain measurement quality and comparability.
If a common method is useful mainly because everyone else uses it
Investigate its methodological basis before treating convention as a strength.
If a strong feature depends on a population, context, or purpose different from yours
Reassess whether its advantages actually transfer to the new study.
If changing a strong feature would make comparison with prior evidence substantially harder
Require a substantive methodological reason for the change rather than novelty alone.

Now compare this preserve list with the weaknesses you decided to address deliberately. Together, they give you a more balanced design strategy: retain what previous research established well and change what prevents the literature from answering the next important question.

If those changes accumulate until the original project barely remains recognizable, however, the issue is no longer simply which features to preserve. You may need to ask whether the literature is pointing you toward a different study altogether.

07 · A Quick Checklist

What From Previous Research Is Worth Keeping?

Before replacing established features of previous studies, check:
Have I identified methodological and conceptual strengths as deliberately as I identified weaknesses?
Can I explain why a feature was strong rather than merely observing that it was common?
Does the feature remain aligned with my research question, population, setting, and intended inference?
Would preserving it improve comparability with strong previous evidence?
If I am replacing an established measure, comparator, or procedure, can I identify the specific problem the replacement solves?
Am I introducing methodological novelty mainly to make the study appear different?
Have I preserved transparent procedures and documentation practices that made previous research easier to evaluate?
Does my final design clearly distinguish what I am intentionally preserving from what I am intentionally improving?
08 · Frequently Asked Questions

Questions About Preserving Strengths From Previous Studies

How do I identify a strength in a previous study?

Ask what feature helped the study answer its question credibly. Consider conceptual clarity, alignment between question and design, appropriate sampling, measurement quality, meaningful comparisons, timing, analytical coherence, transparency, and other design-specific features. Use appropriate critical-appraisal or methodological guidance where available.

Should I use the same questionnaire as previous researchers?

Use it when it measures the construct you need and appropriate evidence supports its intended interpretation in your population and context. Comparability is an additional advantage, but previous use alone is not sufficient justification.

Will preserving previous methods make my study less original?

Not necessarily. Research contribution does not require every methodological element to be new. Preserving defensible features can make the effect of your targeted change easier to interpret and can strengthen comparison with existing evidence.

Can I preserve only part of a previous design?

Yes. You might preserve the measure while changing the population, retain the comparator while extending follow-up, or reproduce an intervention protocol while changing the outcome. Evaluate each feature according to its function in the new study.

What if the strongest previous studies use different methods?

Determine what each method was designed to accomplish and which properties matter for your question. Different strong studies may embody different trade-offs rather than one being universally superior. Your choice should follow the inference you need.

Should I preserve methods to make a replication possible?

If replication is part of the study's purpose, preserving the features necessary to reproduce the original test is especially important. Deliberate changes can still be introduced in an extension or conceptual replication, but specify what remains constant and what changes so the resulting evidence can be interpreted appropriately.

What if an established method is strong but impractical for my study?

Feasibility matters. Determine which property made the method valuable and whether a feasible alternative can preserve that property. If not, acknowledge what is lost and ensure the research question and claims remain compatible with the method you can actually implement.

09 · The Bottom Line

Improvement Does Not Require Starting Over

The Bottom Line

Preserve strengths from previous studies when they remain well justified for your question and help produce valid, interpretable, comparable, or transparent evidence.

The literature should teach you what to change and what to keep. A strong new study is not necessarily the one that looks least like its predecessors. Often it is the one that preserves what previous research already does well while changing, deliberately and selectively, the features that still prevent the field from answering an important question.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes