Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Much Recruitment Uncertainty Is Too Much Before a Study Begins?

Some recruitment uncertainty is unavoidable, but a study becomes fragile when its success depends on several optimistic assumptions being correct. Learn how to identify when uncertainty is large enough to investigate before committing.

452
How Much Recruitment Uncertainty Is Too Much? Guide 452 of 603
01 · The Question

You cannot eliminate recruitment uncertainty, so how much can you reasonably accept?

Before recruitment begins, you rarely know exactly how many people you will identify, reach, screen, find eligible, or enroll. Even well-planned studies encounter uncertainty because recruitment involves institutions, communication channels, eligibility criteria, human decisions, and time.

The presence of uncertainty is therefore not evidence that a study is infeasible.

The more important question is whether your study can tolerate being wrong about its recruitment assumptions. A project may be reasonably robust when several plausible recruitment outcomes still produce an adequate sample. Another may succeed only if nearly every assumption turns out favorably.

That difference matters. Recruitment uncertainty becomes concerning not simply when you lack perfect information, but when plausible departures from your assumptions could prevent the study from obtaining the evidence it needs.

02 · The Short Answer

Uncertainty becomes too much when the study depends on optimism

In Brief

Recruitment uncertainty becomes too great when plausible variation in access, eligibility, willingness, recruitment rate, or other recruitment assumptions could make the study unable to obtain its required sample within the available time and resources, especially when there is little capacity to recover.

There is no universal percentage of uncertainty that separates feasible from infeasible research. Judge uncertainty in relation to the study's recruitment margin, quality of the supporting evidence, number of uncertain assumptions, consequences of being wrong, and availability of realistic corrective options.

03 · What You Need to Know

Recruitment risk depends on both uncertainty and its consequences

Some recruitment uncertainty is normal

Recruitment plans are forecasts. They depend on quantities that may not be known precisely before the study begins: how many people will encounter the invitation, how many will respond, how many will satisfy eligibility criteria, how many eligible individuals will consent, and how quickly enrollment will occur.

Even pilot and feasibility studies produce estimates with uncertainty. Preliminary recruitment performance should therefore inform planning without being mistaken for a guarantee of what will happen in the main study.

The objective is not to remove uncertainty. It is to determine whether the uncertainty threatens the study's ability to answer its research question.

Ask what happens if your assumption is wrong

Suppose two studies both expect 40% of eligible participants to enroll.

The first needs 100 participants and can realistically approach 1,000 eligible people. Even if enrollment falls to 20%, the available pool may remain sufficient.

The second also needs 100 participants but can approach only 260 eligible people. At the expected 40% enrollment fraction, approximately 104 would enroll. A relatively small shortfall would put the target out of reach.

The assumed rate is identical. The recruitment risk is not.

Recruitment uncertainty How unsure you are about what will happen during recruitment.
Recruitment vulnerability How seriously the study is affected if recruitment performs worse than expected.

A highly uncertain assumption may be tolerable when the study has substantial margin. A moderately uncertain assumption may be dangerous when the study has almost none.

Look for stacked assumptions

Recruitment plans often appear plausible because assumptions are considered separately.

You may assume that a site will approve access, that 600 people can be reached, that half will qualify, that half of those will participate, and that recruitment can be completed within six months. None of those assumptions may appear extraordinary by itself.

But the final recruitment yield depends on all of them operating together.

Site access The proposed institution must permit the recruitment process.
Reach The approved process must expose enough appropriate people to the invitation.
Eligibility Enough of those people must satisfy the inclusion and exclusion criteria.
Willingness Enough eligible people must agree to participate.
Time Those conversions must occur quickly enough to meet the study's recruitment deadline.

When several uncertain assumptions all need favorable outcomes, the study can be much more fragile than any single estimate suggests.

Distinguish evidence from hope

Not every recruitment assumption deserves the same confidence.

An expected eligibility fraction derived from recent screening records at the actual study site is different from one borrowed from a study conducted in another country with different eligibility criteria. A recruitment rate observed using the same procedures is more informative than “the administrator thinks plenty of people will participate.”

When evaluating uncertainty, ask what supports each important assumption. Evidence may include site records, previous recruitment data, comparable studies, aggregate population information, or appropriately conducted feasibility work.

If eligibility itself is uncertain, it may be useful to estimate how many potential participants are likely to qualify. If the uncertainty concerns enrollment, examine whether eligible people are likely to agree to participate.

Use scenarios rather than one forecast

A single recruitment estimate can conceal how sensitive the study is to uncertainty. Scenario analysis makes that sensitivity visible.

Suppose you can realistically approach 500 eligible people and need 150 participants:

Enrollment assumption Expected enrollment Implication
40% 200 Comfortably above the target
30% 150 Exactly at the target, with no recruitment margin
20% 100 Substantially below the target

The useful question is not which percentage you prefer. It is which percentages are genuinely plausible and what the study would do under each scenario.

If only the optimistic scenario succeeds, recruitment uncertainty is consequential. If conservative scenarios still succeed, the study is more robust.

Calculate the recruitment pace the study requires

Population size alone does not tell you whether recruitment can finish on time. A study may have access to enough people eventually but still be unable to enroll them quickly enough.

A Simple Planning Check
Required average recruitment rate = Required sample ÷ Available recruitment time
The required sample is the number of participants that must be enrolled during the recruitment period. Available recruitment time should be expressed in a consistent unit such as months.
If 240 participants must be enrolled within 12 months, the simple average requirement is 20 participants per month. If available evidence suggests that recruitment could plausibly range from 10 to 25 per month, the study's feasibility depends heavily on where within that range actual performance falls. The calculation is a planning average and does not imply that recruitment will remain constant over time.

This is particularly important for student projects and other time-limited studies. An enrollment target that might be attainable over three years may be entirely unrealistic within one semester.

Consider whether the uncertainty can be reduced before committing

Some uncertainties are relatively inexpensive to investigate. You may be able to obtain aggregate counts from a site, clarify recruitment procedures with a gatekeeper, examine previous response rates, or verify how many potentially eligible people pass through a service each month.

Other uncertainties may require more formal feasibility work. When recruitment is central to whether the study can proceed and existing evidence is weak, it may be appropriate to test the recruitment pathway before finalizing the study.

Recruitment-feasibility frameworks recommend specifying recruitment goals, tracking the process systematically, and evaluating whether those goals are met rather than simply reporting how many participants happened to enroll. Such tracking can also identify where potential participants are lost and which recruitment methods might need modification.

Prespecified progression criteria can help, but they should not be arbitrary

In pilot and feasibility research, investigators may specify progression criteria before collecting data. These criteria connect observed feasibility outcomes with decisions about whether to proceed, modify the study, or reconsider progression.

A traffic-light structure is often used:

Result Interpretation Possible decision
Green Recruitment performance meets the desired level Proceed under the planned recruitment approach
Amber Performance is below the goal but potentially recoverable Modify recruitment or design before proceeding
Red Performance falls below a minimum acceptable level Do not proceed unchanged

The thresholds should correspond to what the future study actually requires. Methodological guidance on pilot trials recommends prespecifying feasibility parameters and meaningful goal and minimum thresholds rather than choosing cutoffs after seeing the results.

At the same time, missing a threshold need not always produce a mechanical stop decision. Recruitment tracking may reveal a modifiable reason for the shortfall. For example, investigators may identify excessive participant burden or a weak recruitment channel that can credibly be changed.

Ask whether you have a realistic recovery path

The same uncertainty is less dangerous when the study has viable corrective options.

If recruitment is slower than expected, can you extend recruitment without compromising the project? Can additional appropriate sites be added? Is there another legitimate channel to the same population? Can unnecessary participant burden be reduced? Are there scientifically defensible eligibility changes?

A backup plan counts only when it is operationally and scientifically plausible. “We will find another site” is not much protection if no alternative site has been identified and each new site requires months of approval.

Likewise, replacing the target population with whoever is easiest to recruit may solve the logistics while changing the study. Before treating population substitution as a contingency, consider whether a more accessible population would change the scientific question.

Some uncertainty deserves more caution in student research

A student may have less ability to absorb recruitment delays than a large funded project. Academic deadlines, graduation schedules, ethics-review cycles, semester calendars, and limited staffing can make recovery difficult.

Dependence on a single unconfirmed gatekeeper is especially consequential when losing that gatekeeper would eliminate the only viable participant pool. In such cases, consider whether the research question depends too heavily on access controlled by one powerful gatekeeper.

This does not mean student research should avoid every difficult population. It means the acceptable uncertainty should reflect how much time and flexibility the project actually has.

Watch Out

Do not call a recruitment plan “feasible” simply because none of its individual assumptions looks impossible. If several uncertain assumptions must all turn out favorably and the study has no credible recovery path, their combined effect may make the design substantially more fragile than it first appears.

04 · A Practical Example

When a plausible recruitment plan becomes fragile after conservative assumptions are applied

Hypothetical Example

A study that needs 180 completed participants

A researcher plans to recruit 180 participants over nine months from two institutions. Preliminary conversations suggest that approximately 1,000 people belong to the broad population of interest.

Initial impression Recruiting 180 people from a population of approximately 1,000 appears manageable.
Access uncertainty is added Only one institution has provisionally agreed to recruitment, reducing the immediately plausible pool to about 550 people.
Eligibility is considered Available evidence suggests that perhaps 50% to 70% will satisfy all study criteria, leaving approximately 275 to 385 eligible people.
Willingness is considered If 40% of eligible people enroll, the study might obtain roughly 110 to 154 participants from that site, below the required 180.
The real uncertainty becomes visible The study now depends on securing the second site, achieving eligibility and enrollment near the favorable ends of their ranges, or finding another credible recruitment source.
The researcher acts before committing Instead of assuming the missing participants will somehow appear, the researcher clarifies access to the second site and considers a focused recruitment feasibility assessment.

No individual assumption was obviously unreasonable. The problem emerged because several favorable assumptions were required simultaneously. Scenario analysis exposed that dependence before recruitment began.

05 · What Researchers Often Get Wrong

Recruitment uncertainty is not just about whether your estimate is accurate

Misconception

“Every study has uncertainty, so there is no point worrying about it.”

Uncertainty is unavoidable, but its consequences differ. A study with substantial recruitment margin may tolerate considerable error, while a study operating close to its minimum requirement can fail after a relatively small shortfall.

Misconception

“My recruitment assumptions are all reasonable.”

Reasonable assumptions can still create a fragile plan when several must all be correct at once. Examine the combined pathway rather than evaluating each assumption independently.

Misconception

“I should use the most likely recruitment estimate.”

A central estimate is useful, but it can conceal sensitivity. Conservative and optimistic scenarios show whether modest changes in recruitment performance alter the study's feasibility.

Misconception

“If recruitment falls short, we will fix it later.”

That is useful only when credible corrective options exist. Additional sites, longer recruitment, revised procedures, or broader criteria may require approvals, resources, and scientific compromises that cannot be introduced quickly.

Misconception

“A pilot removes recruitment uncertainty.”

A pilot can reduce uncertainty and reveal bottlenecks, but its recruitment estimates are themselves uncertain and may not transfer perfectly to the main study. Differences in scale, sites, staffing, participant burden, or procedures can change subsequent recruitment performance.

06 · What This Means for You

Ask whether your study survives a reasonably bad recruitment outcome

A useful feasibility assessment does not require you to predict recruitment perfectly. It asks whether the study remains viable when reality is somewhat less favorable than your preferred forecast.

A simple decision framework

If conservative recruitment assumptions still produce the required sample
The remaining uncertainty may be acceptable, assuming other aspects of the study are feasible.
If the study succeeds under the central estimate but fails under a plausible conservative scenario
Treat recruitment as a meaningful feasibility risk and look for stronger evidence or additional recruitment margin.
If several weakly supported assumptions must all be favorable
Reduce the most consequential uncertainties before committing to the study.
If recruitment underperforms but credible modifications can restore feasibility
Plan those contingencies explicitly, including the approvals, resources, and time they would require.
If modest recruitment underperformance makes the study impossible and there is no realistic recovery path
The current design carries too much recruitment uncertainty to treat feasibility as established.

What counts as “too much” therefore depends on fragility. A study with uncertain recruitment but substantial reserve capacity may be reasonable. A study with apparently precise estimates but no margin for error may be much riskier.

07 · A Quick Checklist

Before accepting recruitment uncertainty, stress-test the plan

Before committing to the recruitment plan, check:
List the major assumptions about access, reach, eligibility, willingness, recruitment rate, and time.
Identify what evidence supports each consequential recruitment assumption.
Distinguish well-supported estimates from informal expectations or optimistic guesses.
Model conservative, central, and optimistic recruitment scenarios where uncertainty is meaningful.
Calculate the average recruitment pace required by the study's actual timeline.
Check whether several uncertain assumptions must all be favorable for the study to succeed.
Identify realistic corrective options if recruitment performs worse than expected.
Confirm that backup populations, sites, or channels preserve the scientific requirements of the research question.
Investigate further when modest recruitment underperformance would make the study impossible.
08 · Frequently Asked Questions

Questions about recruitment uncertainty before a study begins

Is there an acceptable percentage of recruitment uncertainty?

No universal percentage applies across studies. The important issue is whether plausible uncertainty changes the feasibility decision. A wide range may be acceptable when even its conservative end meets the study's needs, while a much narrower range may be problematic when the study barely meets its target.

How conservative should my recruitment estimate be?

Use scenarios supported by the evidence rather than choosing an arbitrarily pessimistic percentage. The conservative scenario should represent a credible worse-than-expected outcome, not an impossible worst case.

What if I have no previous recruitment data?

Use the strongest relevant evidence available, such as site counts, comparable studies, eligibility information, previous recruitment through similar channels, or preliminary feasibility inquiries. If the missing information is central to whether the study can succeed, consider collecting feasibility evidence before committing.

Does a large population make recruitment uncertainty less important?

Only if enough members of that population can realistically be reached, qualify, and enroll within the study period. A large theoretical population provides little protection when access is narrow or the recruitment pathway has a severe bottleneck.

Should I set a minimum recruitment threshold before the study?

For formal pilot or feasibility work, prespecified progression criteria can support transparent decision-making. Thresholds should correspond to the recruitment performance the future study requires and should account for credible modifications rather than being selected merely because a particular percentage sounds rigorous.

What if recruitment is uncertain but there is no better research question?

The scientific importance of a question does not remove its feasibility constraints. You may decide that the uncertainty is worth accepting, particularly for exploratory work, but the risk should be explicit and the design should not claim recruitment feasibility that has not been established.

When should I test recruitment rather than estimate it?

Testing becomes more valuable when recruitment is a major unresolved uncertainty, existing evidence is weak, and failure to achieve the required recruitment performance would undermine the study. A feasibility test is particularly useful when it can change the decision or identify a modifiable bottleneck.

09 · The Bottom Line

Recruitment uncertainty is too much when the study has no room to be wrong

The Bottom Line

Recruitment uncertainty becomes too great when realistic variation in access, eligibility, willingness, recruitment rate, or timing could prevent the study from obtaining its required sample and there is no credible way to recover.

Do not search for a universal acceptable percentage. Stress-test the recruitment pathway, examine how well its assumptions are supported, and ask whether conservative but plausible outcomes still leave a viable study. The less margin you have for recruitment underperformance, the stronger the evidence you should want before committing.

10 · Sources and Further Reading

Sources and further reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes