Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Much Effort Should You Spend Obtaining One Difficult-to-Access Paper?

Not every inaccessible paper deserves the same retrieval effort. Learn how to decide when another search, library request, or author email is justified and when it is reasonable to stop.

247
How Long to Keep Searching for a Paper Guide 247 of 899
01 · The Question

When Does Persistence Stop Being Good Research Practice?

You have a citation for a paper that appears relevant. The DOI works, but the article is inaccessible. Your library does not have it. Repository searches lead nowhere. The author's old institutional page has disappeared. After several attempts, you are still looking.

Should you keep going?

There is no universal number of minutes, searches, or emails that makes a retrieval effort “enough.” The appropriate effort depends primarily on what the paper could contribute to your research and what would happen if you proceeded without it. A potentially decisive study in a systematic review deserves a different retrieval effort from a tangential citation you hoped might provide one more sentence for a background paragraph.

The goal is therefore not maximal persistence. It is proportionate retrieval: spending enough effort to reduce an important evidential uncertainty without allowing one source to consume resources far beyond its likely contribution.

02 · The Short Answer

Let the Paper's Evidential Importance Determine the Effort

In Brief

Spend more effort obtaining a difficult paper when it is potentially eligible, uniquely informative, central to an important claim, or necessary for data extraction or methodological appraisal. Spend less when the source is peripheral, redundant, or replaceable by accessible primary evidence.

There is no defensible universal time limit. Instead, use a stopping rule based on the paper's importance, the retrieval routes already attempted, the likelihood that another attempt will succeed, and the consequences of proceeding without the source. In systematic reviews, retrieval attempts and reports that cannot be obtained should be documented rather than quietly disappearing from the review process.

03 · What You Need to Know

Retrieval Effort Should Be Proportionate to Evidential Value

Not every inaccessible paper creates the same problem

A difficult source can matter for very different reasons. Perhaps it appears to be the only study of a particular population. Perhaps it contains the numerical result needed for a meta-analysis. Perhaps it is merely one of several papers supporting a well-established background statement.

Those situations should not receive identical treatment. The rational question is not simply “How difficult is this paper to obtain?” but “How consequential would it be if I never obtained it?”

Situation Likely retrieval priority Why
Potentially eligible report in a systematic review High Failure to retrieve it can affect study selection and the completeness of the evidence base
Paper containing unique data needed for analysis High The missing information may directly affect the analysis
Source central to a contested claim High Direct verification may materially affect your interpretation
One of many sources supporting the same background fact Lower Accessible primary evidence may answer the same question
Interesting but peripheral citation Lower The likely informational gain may not justify extensive retrieval work

Systematic reviews require a more structured retrieval process

Formal evidence synthesis changes the calculation. The Cochrane Handbook describes retrieving full-text reports of potentially relevant studies as part of the study-selection process and recommends corresponding with investigators where appropriate when information needed to determine eligibility or obtain missing information is unavailable. If information remains unobtainable, the review process should record that status rather than pretend that the report was assessed normally.

PRISMA 2020 likewise explicitly accommodates reports that were sought but could not be retrieved. Guidance accompanying PRISMA explains that this category can include reports unavailable through local collections or interlibrary loan, failures to obtain material from authors, and broken links.

This does not mean you must search indefinitely. It means that failure to retrieve a potentially relevant report is itself information about the review process and should be made visible.

Start with high-yield, low-cost routes

Before deciding that a paper is genuinely difficult to obtain, use the routes most likely to solve the problem quickly. Resolve the DOI, inspect the publisher page, search the exact title, check your institutional library, look for legitimate repository copies, and inspect author or institutional pages where appropriate.

If the article is subscription-restricted, the relevant options are those used when a research paper is behind a paywall. If you can locate only the bibliographic record, follow a structured process for dealing with a citation whose full text cannot initially be found.

Escalate when the paper matters enough

If ordinary searching fails and the source is important, escalate to routes that require more effort. Depending on your context, these may include interlibrary loan or document delivery, help from a research librarian, searching specialized repositories or catalogs, tracing another legitimate version, and contacting the corresponding author.

These routes are not interchangeable. A library request may be particularly appropriate for an older journal article held elsewhere, while author contact may be efficient for an accepted manuscript or an associated file. If direct author contact is appropriate, make the request specific and concise rather than sending a generic demand for access. The practical considerations involved in requesting a paper from its author apply here.

Ask what another retrieval attempt is likely to change

Suppose you have already checked the publisher, your library, several appropriate repositories, and the author's current institutional profile. You have also submitted an interlibrary-loan request. Running the same title through six additional general search engines may add very little.

This is a marginal-value problem. Each additional retrieval attempt has a cost in time and attention. Continue when another route has a plausible chance of succeeding and the paper matters enough to justify that cost. Stop when you are merely repeating low-yield searches without changing the evidential situation.

Replaceable sources deserve less heroic searching

Sometimes you want a paper because another author cited it for a broad proposition. If several accessible primary studies or authoritative sources establish the same point, obtaining that one paper may add little to your work.

That does not mean replacing sources casually. Two papers that sound similar may study different populations, measures, interventions, or periods. But if your informational need can genuinely be satisfied by stronger accessible evidence, there is little methodological virtue in spending hours pursuing a particular citation merely because you encountered it first.

Unique sources deserve more effort

The calculation changes when the inaccessible source appears irreplaceable. An old study may be the only evidence for a population. A paper may contain the only available estimate needed for a meta-analysis. A methodological article may be the original source of a procedure repeatedly described secondhand.

In such cases, another retrieval attempt can have substantial informational value. Library assistance, archival searching, author contact, or tracing related reports may be justified even when you would have abandoned a peripheral source much earlier.

Do not use citation count or journal prestige as your stopping rule

A highly cited paper is not automatically important to your particular research question, and an obscure paper may contain exactly the evidence you need. Likewise, journal prestige does not determine whether retrieving an individual source is worth your time.

Evaluate relevance, uniqueness, and consequence. Retrieval effort should follow your research need, not the social status of the citation.

Set stopping rules before frustration sets them for you

A simple stopping rule can make retrieval decisions more consistent. For example, you might decide that a potentially important source receives the standard retrieval routes first, followed by one or more escalation routes appropriate to your project. If those fail, you document the source as unobtainable unless new information emerges.

The exact rule should fit the research design. A doctoral thesis, rapid review, scoping review, historical investigation, and casual literature search operate under different resource constraints. What matters is that the rule reflects methodological purpose rather than your patience on a particular afternoon.

Watch Out

Do not stop searching for difficult papers simply because their results are inconvenient, nor pursue them more aggressively because you expect them to support your argument. Retrieval decisions should be based on relevance and methodological need, not anticipated findings.

Keep a retrieval log when the stakes are high

For formal reviews and other reproducible research, record the routes you attempted and their outcomes. A brief log might include the DOI or citation, publisher access, library search, repository search, interlibrary-loan request, author contact, dates, and final retrieval status.

This serves two purposes. It prevents repeated searches that have already failed, and it allows another researcher to understand why the source was not used. More importantly, it separates “we did not bother to obtain this paper” from “we made reasonable attempts but could not retrieve it.” Those are methodologically different situations.

04 · A Practical Example

Two Inaccessible Papers Do Not Necessarily Deserve the Same Effort

Hypothetical Example

One paper may change the synthesis; the other probably will not

Imagine that you are conducting a systematic review and encounter two inaccessible papers. Paper A appears, from its title and abstract, to be the only study involving an important population and may meet your eligibility criteria. Paper B is cited in the introduction of another article for a general definition that is already supported by several accessible sources.

Paper A: Verify the citation Confirm the DOI, journal record, authors, and any related reports of the study.
Paper A: Use standard access routes Check institutional access, legitimate repositories, and library holdings.
Paper A: Escalate Use interlibrary loan or document delivery where available and contact the corresponding author if appropriate.
Paper A: Document the outcome If it remains unobtainable, record it as a report sought but not retrieved rather than silently excluding it after abstract screening.
Paper B: Clarify what you actually need Determine whether your argument depends on that specific source or merely on the general concept attributed to it.
Paper B: Stop when replacement evidence answers the question If accessible primary or authoritative sources adequately support the point and the original citation has no unique role, extensive retrieval may have little value.

The difference is not that Paper A is inherently “better.” Its absence creates greater uncertainty for the particular research task. Retrieval effort should respond to that uncertainty.

05 · What Researchers Often Get Wrong

Common Mistakes When Deciding How Long to Keep Searching

Misconception

You should spend the same amount of effort on every paper

Equal time is not necessarily equitable effort. Sources differ in relevance, uniqueness, and consequences for the research. A potentially eligible study in a systematic review warrants different treatment from a peripheral background citation.

Misconception

A serious researcher never gives up on a source

Research operates under finite time and resources. Persistence is valuable when another retrieval attempt has plausible informational value. Repeating exhausted searches indefinitely is not methodological rigor.

Misconception

If the abstract looks unimportant, you can stop trying to retrieve the paper

That can be problematic in a formal review when eligibility requires full-text assessment. Apply the review's prespecified selection process rather than allowing access difficulty or an impression from the abstract to become an undocumented exclusion criterion.

Misconception

If one retrieval route fails, the paper is unavailable

A publisher paywall or broken URL establishes only that one route failed. Libraries, repositories, legitimate alternative versions, and author contact may provide other routes.

Misconception

The most highly cited inaccessible paper deserves the most effort

Citation count does not determine relevance to your research question. A rarely cited study can be uniquely important to your analysis, while a famous paper may be peripheral.

06 · What This Means for You

Use a Proportionate Retrieval Strategy

A simple decision framework

If the paper may determine eligibility, contribute unique data, or materially affect your conclusion
Use multiple legitimate retrieval routes and escalate to library or author assistance where appropriate.
If the source is useful but not unique
Try the standard high-yield routes, then consider whether accessible evidence adequately satisfies the same research need.
If the source is peripheral and readily replaceable
A limited retrieval effort may be proportionate; do not allow one citation to consume time needed for more consequential evidence.
If another retrieval route has a realistic chance of success
Consider the expected informational benefit before deciding whether to continue.
If reasonable routes have failed and additional searches merely repeat them
Stop, document the retrieval failure when relevant, and adjust your analysis or reporting accordingly.

For an informal literature search, your stopping rule may be quite modest. For a systematic review, evidence synthesis, replication, or historical analysis, the standard should generally be more explicit because missing evidence can alter the resulting evidence base.

Most importantly, do not turn “I could not obtain it” into “it does not matter.” Those are separate judgments. Sometimes the correct outcome is to stop searching while still acknowledging that the missing paper leaves uncertainty.

07 · A Quick Checklist

Before You Spend Another Hour Looking for One Paper

Before continuing the search, check:
Clarify exactly what information you expect the paper to contribute.
Determine whether the paper could materially affect eligibility, extraction, analysis, interpretation, or an important claim.
Confirm that you have already checked the DOI, current publisher page, institutional access, and appropriate legitimate repositories.
Consider interlibrary loan, document delivery, or librarian assistance when the source is sufficiently important.
Contact the corresponding author when direct contact is appropriate and other reasonable routes have failed.
Ask whether accessible primary evidence can genuinely answer the same question without substituting a non-equivalent source.
Consider whether another retrieval attempt has a realistic chance of producing new information.
Record unsuccessful retrieval attempts when transparency or reproducibility matters.
If you stop, distinguish inability to retrieve the paper from evidence that the paper is irrelevant or invalid.
08 · Frequently Asked Questions

Questions About How Long to Keep Searching for a Paper

Is there a recommended number of minutes to spend finding a paper?

No universal time limit applies across research contexts. The appropriate effort depends on the paper's likely importance, the consequences of not retrieving it, available resources, and whether further retrieval routes have a reasonable prospect of success.

Should I contact an author for every inaccessible paper?

Not necessarily. Author contact is more justified when the paper is important and ordinary legitimate access routes have failed. In large reviews, a systematic contact procedure may be preferable to ad hoc decisions.

Should I use interlibrary loan for a single paper?

It can be appropriate when your institution offers the service and the paper is important enough to justify the request. Library access is particularly useful when a legitimate copy cannot be found online.

Can I exclude a study from a systematic review because I cannot obtain the full text?

Do not disguise retrieval failure as an ordinary eligibility exclusion. PRISMA 2020 provides for reporting reports that were sought but not retrieved, and systematic-review procedures should document what happened to potentially relevant records.

What if another paper summarizes the inaccessible study?

A secondary description may help you understand why the source matters, but it does not give you direct access to the original evidence. Whether to use it depends on your purpose and on the rules governing secondary citation when the original source cannot be obtained.

When should I finally stop?

A reasonable stopping point occurs when you have exhausted the retrieval routes justified by the source's importance and further attempts have little realistic prospect of changing the evidential situation. Document the unresolved access problem when it matters to your research.

09 · The Bottom Line

Spend Retrieval Effort Where Missing Evidence Matters Most

The Bottom Line

There is no universal amount of time you should spend obtaining one difficult paper. The effort should increase with the paper's relevance, uniqueness, and potential effect on your research, and decrease when the source is peripheral, redundant, or genuinely replaceable.

Use a defined sequence of legitimate retrieval routes, escalate when the evidence warrants it, and stop when additional attempts have little expected value. If an important source remains unobtainable, document that fact rather than allowing it to disappear silently from your research process.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes