Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Which Research Methods Are Missing From the Existing Literature?

An unused method is not automatically a methodological gap. Learn how to identify when the methods missing from a literature prevent researchers from answering an important question.

741
Methods Missing From the Literature Guide 741 of 899
01 · The Question

What Can the Literature Not Investigate Well With the Methods It Currently Uses?

Once you identify the methods that dominate a literature, the obvious next question is what is missing. Perhaps almost every study is cross-sectional and none follows participants over time. Perhaps researchers rely on self-report while behavioral evidence is scarce. Perhaps experimental studies establish effects but little qualitative work examines how participants experience the intervention.

These patterns can reveal methodological gaps. They can also tempt researchers into weak reasoning: “Nobody has used Method X, so I will.”

A method does not become scientifically necessary merely because it is absent. A meaningful methodological gap exists when the available approaches leave an important research question, inference, mechanism, population, outcome, or evidential limitation insufficiently addressed and another methodological approach could help resolve it.

02 · The Short Answer

Identify Missing Evidential Capabilities Before Missing Method Names

In Brief

A research method is meaningfully missing when an important question requires evidence that the methods currently used in the literature do not adequately provide, and a different design, data source, measurement strategy, temporal structure, or analytical approach could materially reduce that uncertainty.

Do not begin with “Which method has nobody used?” Begin with “What important thing can the existing evidence not tell us, and what methodological capability would allow us to investigate it?”

03 · What You Need to Know

How to Find Methodological Gaps That Actually Matter

Start With the Unresolved Question, Not Your Preferred Method

Methodological gap hunting often goes backward. A researcher wants to conduct interviews, structural equation modeling, an experiment, a longitudinal study, or a mixed methods project and then searches for evidence that nobody has used that approach before.

A stronger sequence begins with the knowledge problem.

1. Identify the uncertainty What important question remains unresolved?
2. Diagnose the evidential limitation Why can the existing studies not answer it adequately?
3. Identify the required evidence What observations, comparisons, measurements, time structure, or perspectives would reduce that uncertainty?
4. Select the method Which feasible design can produce that evidence with acceptable assumptions and limitations?

This keeps the research question in charge of the methodology rather than the other way around.

Map What the Existing Methods Can and Cannot Support

Begin with the methods that currently dominate the literature. Then ask what forms of inference those approaches are well suited to support.

Different methodological structures provide different kinds of leverage. A cross-sectional design may characterize prevalence or association at a given period but generally offers less information about within-person change or temporal ordering. Longitudinal designs can examine change over time but do not automatically eliminate confounding. Randomized studies can provide strong leverage for estimating intervention effects under appropriate conditions, but some questions cannot feasibly or ethically be randomized.

Cochrane explicitly recognizes that some review questions cannot be answered by randomized trials alone and that non-randomized evidence may be useful for long-term or rare outcomes, different populations and settings, or forms of intervention delivery not adequately represented in randomized trials. It simultaneously cautions that non-randomized intervention studies require careful assessment of confounding and other biases.

There is no universally superior design detached from a question. The gap lies in a mismatch between the evidence required and the evidence currently available.

Missing Methods Can Occur at Several Levels

A methodological gap does not always mean an entire study design is absent. The missing capability may be much more specific.

Potential methodological gap What may remain difficult to establish Possible methodological response
No longitudinal evidence Change, persistence, trajectories, temporal ordering Repeated-measures or longitudinal designs
No credible comparison condition for an intervention question Effect relative to an alternative or counterfactual An appropriate experimental or quasi-experimental comparison
Heavy reliance on self-report Observed behavior or objectively recorded outcomes Behavioral, performance, administrative, sensor, or other appropriate measures
Outcome studies without process evidence How implementation or mechanisms unfold Process-oriented qualitative or mixed methods investigation
Rich qualitative description without population-level estimates Distribution or magnitude within a defined population Appropriate quantitative sampling and measurement
Single-source data Whether findings depend on one measurement perspective Independent or complementary data sources
No integration across complementary evidence How numerical patterns relate to experiences or processes Purposefully integrated mixed methods where warranted

These are examples, not prescriptions. Each methodological response introduces its own assumptions, biases, costs, and feasibility requirements.

An Absent Method Is Not Automatically a Gap

Suppose no randomized trial exists in a literature. That absence may matter if the central question concerns the causal effect of an intervention that can ethically and feasibly be randomized. But if the question concerns a naturally occurring exposure that researchers cannot assign, the absence of randomization may be entirely unsurprising.

Likewise, a field without ethnography does not automatically need ethnography. A field without machine learning does not automatically need machine learning. A field without mixed methods does not automatically need mixed methods. Academic methodology is not a bingo card.

Unused method An approach that has not appeared, or appears rarely, in the mapped literature.
Methodological gap A missing methodological capability that prevents an important question from being adequately investigated.

The distinction is crucial because novelty of technique and contribution to knowledge are not the same thing.

Sometimes the Missing Element Is Time

Many apparent methodological gaps concern temporal structure rather than an entirely different research tradition.

If most studies collect data once, the literature may have substantial evidence about differences and associations but little evidence about development, persistence, sequence, or change. A longitudinal design could then be valuable if the unresolved question genuinely concerns time.

However, simply measuring the same variables twice does not automatically solve the problem. Follow-up timing, attrition, measurement consistency, analytical strategy, confounding, and the substantive process being studied all matter.

Sometimes the Missing Element Is Measurement

A literature can use diverse study designs while repeatedly measuring a construct in the same way. Heavy dependence on self-reported behavior, for example, may leave uncertainty about actual behavior. Reliance on one instrument may make the evidence vulnerable to the assumptions and limitations of that measure.

In such cases, the methodological gap may concern measurement rather than design. Adding behavioral traces, direct observation, performance measures, administrative records, validated alternative instruments, or another relevant source may provide information the existing evidence cannot.

This is especially important when examining outcomes that researchers repeatedly measure. Apparent agreement across studies may partly reflect repeated use of the same operationalization.

Sometimes the Missing Element Is Process or Explanation

A mature quantitative literature may establish that an intervention produces an effect without explaining how participants experience it, how implementation varies, or why it succeeds in some circumstances and not others.

Qualitative research can be valuable for questions concerning experiences, meanings, processes, implementation, and context. Conversely, rich qualitative evidence does not automatically provide estimates of prevalence, average effects, or population distributions.

The methodological opportunity arises when the unresolved question requires the form of evidence that is missing.

Mixed Methods Should Solve an Integration Problem

Researchers sometimes describe mixed methods as inherently more comprehensive. That is too simple.

NIH's Office of Behavioral and Social Sciences Research characterizes mixed methods research as the intentional collection, analysis, and integration of quantitative and qualitative data when combining them can provide a more comprehensive understanding of a research problem than either form alone. The key word is integration. Running a survey and a few interviews side by side does not automatically create a useful mixed methods design.

Use mixed methods when the research question requires complementary evidence and the integration itself contributes to the answer.

A Missing Method May Be Missing for a Good Reason

Before proposing an unfamiliar design, investigate why previous researchers have not used it.

The method may be ethically inappropriate, prohibitively expensive, infeasible for the population, incompatible with the phenomenon, unable to achieve sufficient follow-up, or dependent on data that do not exist. Sometimes the absence reflects disciplinary habit, but sometimes it reflects a genuine constraint.

Watch Out

“No previous study has used this method” should trigger a feasibility question as well as a novelty claim. Find out whether the method has been overlooked or whether there is a substantive reason researchers have avoided it.

Different Does Not Necessarily Mean Better

Replacing the dominant method with another method may simply exchange one set of limitations for another.

Cochrane's guidance illustrates this clearly for intervention evidence. Non-randomized designs can answer questions not adequately covered by randomized trials, but they may introduce greater concerns about confounding and selection. Conversely, randomized designs have important strengths for causal estimation but may not cover every relevant population, outcome, setting, or time horizon.

A strong methodological justification therefore states both what the proposed approach adds and what limitations remain.

Connect the Methodological Gap to the Weakness in the Evidence

The strongest justification has a chain of reasoning:

Important question → current evidential limitation → missing methodological capability → appropriate design → information the new study could add.

For example, if existing findings are based almost entirely on cross-sectional associations, and the unresolved question concerns whether changes in one variable precede changes in another, a longitudinal approach has an identifiable purpose. If researchers already have strong longitudinal evidence, adding another longitudinal study merely because one particular statistical model has not been used is a much weaker methodological argument.

This reasoning also helps identify where the evidence remains weak for methodological reasons rather than simply because there are too few publications.

04 · A Practical Example

From “Nobody Used Interviews” to a Defensible Methodological Gap

Hypothetical Example

An Intervention That Works Differently Across Classrooms

Imagine a hypothetical literature containing numerous experimental and quasi-experimental studies of a classroom technology. Average effects on learning have been estimated repeatedly, but results vary considerably across implementation settings.

Weak gap statement “Few studies have used qualitative interviews, so this study will use interviews.”
Unresolved question Why does the intervention appear to work well in some classrooms but poorly in others?
Existing limitation Most studies measure intervention exposure and outcomes but provide little information about teacher adaptation, classroom routines, implementation barriers, or how students actually use the technology.
Required evidence Evidence about implementation processes and participant experiences could help explain the observed variation.
Methodological response Purposefully sampled observations and interviews, potentially integrated with implementation and outcome data, could investigate those processes.

The contribution is no longer “using qualitative research because previous studies did not.” The method has a job: producing evidence required to investigate an unresolved explanation.

05 · What Researchers Often Get Wrong

Common Mistakes When Claiming a Methodological Gap

Misconception

Nobody Has Used My Method, Therefore I Have Found a Research Gap

Methodological novelty does not automatically produce substantive novelty. Explain what important uncertainty the method can address that existing approaches cannot adequately resolve.

Misconception

The Opposite of the Dominant Method Must Be What the Field Needs

A quantitative-dominated literature does not automatically require qualitative research, nor does a qualitative-dominated literature automatically require quantitative research. The unresolved question should determine the form of evidence required.

Misconception

Longitudinal Research Automatically Establishes Causality

Temporal information can strengthen some inferences, but longitudinal observation does not by itself eliminate confounding, selection, measurement error, or alternative explanations. Design and analysis still determine what causal claims are defensible.

Misconception

Mixed Methods Is Automatically More Rigorous

Combining quantitative and qualitative components adds value when both are needed and meaningfully integrated. Poorly connected components can increase workload and complexity without improving the answer.

Misconception

A Sophisticated Analysis Can Compensate for Missing Evidence

Advanced analysis cannot create temporal information that was never collected, repair fundamentally inappropriate measurements, manufacture a comparison group, or produce perspectives absent from the data. Analytical sophistication and evidential adequacy are different issues.

Misconception

If a Method Is Missing, It Must Have Been Overlooked

Perhaps, but investigate other explanations. Ethical restrictions, recruitment difficulty, cost, unavailable data, measurement limitations, or incompatibility with the research question may explain why an approach is uncommon.

06 · What This Means for You

Choose the Missing Method Only After You Know What Evidence Is Missing

Your methodological justification should begin with an unresolved substantive question and end with a design capable of producing the evidence needed to investigate it.

A simple decision framework

If the unresolved question concerns change or persistence over time
Consider whether an appropriate longitudinal structure would provide information unavailable from existing studies.
If the unresolved question concerns an intervention effect
Determine what comparison and design features are needed for the causal inference rather than selecting a design label mechanically.
If existing studies establish outcomes but not processes or experiences
Consider methods capable of investigating mechanisms, implementation, context, or participant perspectives.
If findings rely almost entirely on one measurement source
Consider whether an independent or complementary measurement approach would materially test the conclusion.
If quantitative and qualitative evidence answer complementary parts of the same problem
Consider whether intentional integration would provide an answer that either component alone cannot provide.
If an unused method adds novelty but no necessary evidence
Do not treat its absence as a substantive methodological gap.

The method should be the consequence of your gap analysis, not the gap itself.

07 · A Quick Checklist

Before Claiming That a Research Method Is Missing

Test the methodological gap:
Have I systematically mapped the methods and design features already used in the literature?
Can I identify an important unresolved substantive question before naming a new method?
Can I explain why the existing methods cannot adequately answer that question?
Have I identified the specific evidence that is missing, such as temporal, behavioral, causal, experiential, implementation, or complementary evidence?
Does the proposed method actually produce the kind of evidence needed?
Have I considered the assumptions and limitations introduced by the proposed approach?
Have I investigated whether ethical, practical, or data constraints explain why the method is uncommon?
Would the method still be justified if I could not claim that it was novel?
08 · Frequently Asked Questions

Questions About Missing Methods and Methodological Gaps

Is a method a research gap simply because nobody has used it before?

No. Its absence becomes meaningful when the method could provide evidence needed to answer an important question that existing approaches cannot adequately resolve.

Does a cross-sectional literature automatically need longitudinal studies?

No. Longitudinal research is especially relevant when the unresolved question concerns change, development, persistence, or temporal ordering. If those issues are irrelevant to the research question, longitudinal data may add unnecessary complexity.

Does a quantitative literature automatically need qualitative research?

No. Qualitative approaches are useful when the unresolved problem requires evidence about meanings, experiences, processes, implementation, context, or related questions they are suited to investigate. Methodological balance for its own sake is not the objective.

When should I consider mixed methods?

Consider mixed methods when quantitative and qualitative evidence address complementary dimensions of the same problem and integrating them would provide an understanding that either component alone would not adequately supply.

Can a missing measurement method be a methodological gap?

Yes. A literature may contain many study designs while relying heavily on one form of measurement. If that dependence leaves an important construct or outcome inadequately observed, an alternative or complementary measurement strategy may address a genuine evidential limitation.

Should I use a more advanced method simply because previous studies used simpler ones?

Only if the advanced method addresses an identifiable limitation or research question. Complexity is not evidence of methodological improvement by itself.

What if the ideal method is not feasible?

Methodological appropriateness must be balanced with ethical and practical feasibility. State what inference remains limited, select the strongest feasible design for the question, and be explicit about what uncertainty the study cannot remove.

09 · The Bottom Line

The Real Gap Is Missing Evidence, Not an Unused Technique

The Bottom Line

A meaningful methodological gap exists when the approaches used in the literature cannot adequately produce evidence needed to answer an important unresolved question, and another feasible methodological approach could materially improve that evidence.

Do not choose a method because nobody has used it. Identify what the literature cannot currently establish, determine what evidence would reduce that uncertainty, and then select the method capable of producing it. Method follows question, even when the methods section occasionally wishes otherwise.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes