Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Should You Test Recruitment Feasibility Before Finalizing the Study?

When recruitment is uncertain and central to whether a study can succeed, assumptions may not be enough. A focused feasibility test can show whether the proposed recruitment pathway works under realistic conditions.

447
Should You Test Recruitment Feasibility? Guide 447 of 603
01 · The Question

When should recruitment assumptions be tested rather than merely estimated?

Every study begins with assumptions about recruitment. Perhaps you expect a certain percentage of invited participants to respond. You assume that enough will satisfy the eligibility criteria, that cooperating sites can generate a particular number each month, or that a recruitment channel will reach the population you need.

Sometimes those assumptions are supported well enough by previous studies, institutional records, or recent experience that a separate recruitment test would add little. In other cases, the entire study depends on recruitment behavior for which you have weak or indirect evidence.

That is where testing recruitment feasibility becomes useful. Instead of asking only whether your recruitment plan sounds reasonable, you obtain empirical evidence about whether the pathway performs well enough to support the proposed study.

02 · The Short Answer

Test recruitment when unresolved uncertainty could determine whether the study succeeds

In Brief

You should consider testing recruitment feasibility before finalizing the full study when recruitment is a major unresolved uncertainty and failure to achieve the required recruitment performance would make the study impractical, underpowered, excessively prolonged, or otherwise unable to answer its research question.

A useful feasibility test should examine the recruitment pathway under conditions resembling the planned study and measure relevant processes such as reach, screening, eligibility, enrollment, recruitment rate, time, and reasons potential participants are lost along the way.

03 · What You Need to Know

A recruitment feasibility test should answer a decision, not merely produce a pilot sample

First ask whether recruitment uncertainty is important enough to test

Testing recruitment takes time and resources, and it may require ethical, institutional, site, or other approvals depending on what the test involves. It should therefore address a genuine uncertainty.

A separate test may be unnecessary when recruitment has been demonstrated recently in essentially the same population, setting, study conditions, and recruitment pathway, particularly when the available pool is comfortably larger than the required sample.

Testing becomes more useful when the proposed population is difficult to reach, eligibility is uncertain, participation is burdensome, the recruitment channel is untested, several gatekeepers are involved, recruitment must occur quickly, or the sample requirement leaves little margin for disappointing enrollment.

The broader question is how much recruitment uncertainty your study can reasonably tolerate before it begins. A feasibility test is one way of reducing consequential uncertainty. It is not an obligatory ritual for every project.

Define what successful recruitment would have to look like

A feasibility test is difficult to interpret unless you know what recruitment performance the eventual study requires.

Suppose the main study needs 360 participants and has 12 months available for recruitment. Ignoring any planned variation over time, that corresponds to an average of 30 enrolled participants per month. A pilot that recruits eight people in one month has demonstrated that recruitment is possible. It has not demonstrated that recruitment is adequate for the proposed main study.

Recruitment-feasibility research emphasizes specifying recruitment goals and assessing whether those goals are met. The benchmark should therefore come from the demands of your study rather than from an arbitrary percentage borrowed from an unrelated project.

Can we recruit anyone? Demonstrates that some recruitment is possible.
Can we recruit what the study requires? Tests whether the pathway can plausibly deliver the needed sample, composition, and recruitment pace.

Test the whole recruitment pathway where possible

Final enrollment alone tells you whether recruitment underperformed. It does not necessarily tell you why.

A more informative feasibility assessment follows potential participants through the major stages of recruitment:

Potentially reachable How many appropriate people enter the recruitment pool?
Contacted or exposed How many actually receive or encounter the study invitation?
Screened How many proceed to eligibility assessment?
Eligible How many satisfy the inclusion and exclusion criteria?
Enrolled How many eligible people consent and enter the study?

Tracking losses and reasons at each stage can identify whether the problem lies in reach, contact, eligibility, willingness, or another part of the recruitment system. Published recruitment-feasibility frameworks specifically recommend systematic tracking because weak links can then inform modifications to the larger study.

Measure recruitment speed, not just the total recruited

A recruitment test should usually record time. Ten enrollments obtained in one week and ten obtained over six months have very different implications for a study that needs 300 participants.

A simple planning calculation can make the connection explicit:

Recruitment Pace
Required average recruitment rate = Required sample ÷ Available recruitment time
The required sample is the number of participants the study must enroll through the relevant recruitment period. Available recruitment time is expressed in a consistent unit such as months.
If a study needs 240 enrolled participants over 24 months, the simple average requirement is 240 ÷ 24 = 10 participants per month. A pilot producing four participants per month would therefore raise a substantial feasibility concern unless a credible change in sites, methods, or resources could increase the rate. The calculation does not mean recruitment will necessarily be constant from month to month.

Recruitment may accelerate after sites become familiar with procedures or slow once the easiest participants have been approached. For that reason, a very short test may provide a misleading estimate of sustained recruitment performance.

Test conditions that resemble the study you actually plan to conduct

A feasibility test is most informative when the recruitment process resembles the future study.

If the principal investigator personally calls every potential participant during the pilot but the main study will rely on automated emails, the pilot has tested a different recruitment system. Similarly, unusually intensive staff support, temporary advertising funds, exceptional gatekeeper involvement, or a highly productive site can make pilot recruitment appear easier than what the main study can sustain.

Before extrapolating from the test, compare recruitment personnel, sites, communication channels, eligibility criteria, participant burden, incentives where applicable, screening procedures, and available resources with those planned for the full study.

Consider progression criteria before collecting feasibility data

For some pilot and feasibility studies, researchers specify progression criteria in advance. These criteria connect observed feasibility results to decisions about whether and how the larger study should proceed.

A traffic-light approach is sometimes used. A result in a green range may support proceeding, an amber range may indicate that modifications are required, and a red range may indicate that recruitment is unlikely to support the proposed study without substantial redesign.

Possible interpretation Meaning Possible response
Proceed Recruitment performance appears compatible with the main study Continue, subject to the other feasibility findings
Modify Recruitment is below the desired level but credible changes may address the problem Revise the recruitment system and reassess
Reconsider Recruitment is substantially below what the main study requires Reconsider sites, methods, population, timeline, design, or progression

The thresholds should be justified for the actual project. There is no universal recruitment percentage that makes every study feasible. A threshold is useful only when it corresponds meaningfully to the performance required by the proposed study.

Recruitment failure can be useful evidence

A feasibility test that reveals poor recruitment has not necessarily failed. It may have prevented a much larger failure.

Suppose the test reveals that only 10% of contacted people qualify when planning assumed 40%, or that a gatekeeper distributes invitations much less frequently than anticipated. Discovering this while the study can still be redesigned is precisely the kind of information feasibility work is intended to provide.

Empirical studies have shown how recruitment problems can remain consequential even after earlier feasibility work. In the HIMALAIA study, for example, recruitment in the main trial proved substantially slower than anticipated despite a preceding feasibility pilot, and the trial was eventually halted for insufficient recruitment. The case illustrates both the value and the limits of extrapolating recruitment performance from preliminary evidence.

A feasibility test does not have to answer the scientific research question

The primary purpose of a recruitment feasibility test is methodological: can the recruitment system work well enough for the intended study?

It should not be treated as a miniature hypothesis test whose success depends on obtaining a statistically significant substantive result. Pilot and feasibility studies are generally designed around uncertainties relevant to the future definitive study, with data collection and analysis aligned to those feasibility objectives.

Watch Out

Do not declare recruitment feasible merely because the pilot successfully enrolled its own small target. Compare observed recruitment performance with what the full study will require. A pilot can meet its target while still revealing a recruitment rate that is inadequate for the eventual study.

04 · A Practical Example

Testing whether an ambitious recruitment plan can actually deliver

Hypothetical Example

A multisite study that needs 300 participants

A research team plans a study requiring 300 enrolled participants over 15 months. Five institutions have expressed willingness to support recruitment, but none has previously recruited for this particular population and protocol.

Define what the main study needs Across all sites, the study requires an average of approximately 20 enrolled participants per month.
Identify the uncertainty The team does not know how many potentially eligible people each site can identify, how many will qualify, or how many eligible people will consent.
Run a limited feasibility phase Under appropriate approvals, selected sites use recruitment procedures closely resembling those proposed for the main study while the team records identification, contact, screening, eligibility, enrollment, and time.
Compare performance with requirements The observed combined rate is approximately nine enrollments per month, far below the 20 per month required by the original plan.
Locate the bottleneck Tracking data show that willingness among eligible people is acceptable, but far fewer potentially eligible people enter screening than the team expected.
Use the evidence Instead of merely intensifying reminders, the team investigates whether additional sites or a different identification pathway can credibly increase the number entering screening before committing to the original design.

The feasibility test has done more than produce a recruitment percentage. It has identified the stage of the pathway that threatens the study and supplied evidence for a design decision.

05 · What Researchers Often Get Wrong

Recruitment testing is useful only when it resembles the problem you need to solve

Misconception

“If the pilot recruits successfully, the main study will too.”

Not necessarily. The main study may operate for longer, require more sites, use different staff, encounter a depleted participant pool, or lack the intensive support available during the pilot. Feasibility evidence should be interpreted according to how well the tested conditions represent the future study.

Misconception

“We recruited 30 participants, so recruitment is feasible.”

The number alone has little meaning without the denominator, recruitment period, recruitment goal, and process. Thirty participants in one month from a large pool may be encouraging; 30 participants over a year for a study requiring 500 may demonstrate the opposite.

Misconception

“The recruitment rate is the only outcome that matters.”

Rate is important, but the pathway matters too. Eligibility, reach, enrollment, subgroup representation, reasons for loss, site performance, staffing demands, and recruitment costs may all influence whether the recruitment system is workable.

Misconception

“We should test recruitment even when we already have strong evidence.”

Not automatically. Feasibility work should reduce a meaningful uncertainty. If highly relevant and recent evidence already establishes recruitment performance under essentially the same conditions, another test may provide little additional decision value.

Misconception

“A disappointing feasibility result means the study must be abandoned.”

No. The result may reveal a modifiable bottleneck. The relevant question is whether a credible change can produce the performance the main study requires. If not, however, continuing unchanged simply converts known feasibility evidence into foreseeable recruitment difficulty.

06 · What This Means for You

Test recruitment when the decision value justifies the effort

A useful feasibility test sits between casual optimism and an unnecessary pilot. It should address uncertainty that could materially change your decision about the study.

A simple decision framework

If recruitment performance is already supported by strong, closely comparable evidence
A separate recruitment test may not be necessary unless important features of the proposed study differ.
If uncertainty exists but the available population and timeline provide a very large margin
Conservative scenario planning may provide enough evidence without a formal recruitment test.
If recruitment is uncertain and failure would make the study infeasible
Consider testing the recruitment pathway before fully committing to the design.
If several recruitment stages are uncertain
Track the full pathway so the test can identify where losses occur rather than producing only a final enrollment number.
If the observed result falls below what the main study requires
Determine whether a realistic modification can close the gap before deciding whether to proceed.

The purpose is not to eliminate all uncertainty. Research rarely offers that luxury. The aim is to avoid building an expensive or time-sensitive study on a recruitment assumption that could have been tested while the design was still flexible.

07 · A Quick Checklist

Before testing recruitment feasibility, decide what the test must tell you

Before running a recruitment feasibility test, check:
Identify the specific recruitment uncertainty that could threaten the main study.
Calculate the recruitment performance the eventual study actually requires.
Determine whether sufficiently comparable existing evidence already answers the feasibility question.
Use recruitment conditions that resemble those available to the eventual study.
Track reach, screening, eligibility, enrollment, time, and important reasons for loss where relevant.
Consider defining justified progression criteria before examining the results.
Check whether the feasibility phase itself requires ethics, institutional, site, privacy, or other approvals.
Decide in advance what kinds of recruitment modifications would be realistic if performance is weaker than expected.
08 · Frequently Asked Questions

Questions about testing recruitment before the full study

Does every study need a recruitment pilot?

No. A recruitment test is most valuable when an important uncertainty remains and the result could change the study design or decision to proceed. Strong evidence from closely comparable recruitment may make a separate test unnecessary.

How many participants should a recruitment feasibility test include?

There is no universal minimum. The design should provide enough information to address the specific feasibility objective with useful precision or decision value. The relevant unit may sometimes be participants, sites, or even recruitment periods, depending on what is being estimated.

How long should recruitment be tested?

Long enough to provide meaningful evidence about the recruitment process you intend to use. Very short tests may be misleading if recruitment has a start-up period, fluctuates over time, or initially captures unusually easy-to-recruit participants.

What should I record during a recruitment feasibility test?

Record the stages relevant to your recruitment pathway, such as the number potentially reachable, contacted, screened, eligible, consented, and enrolled; time required; reasons for loss where appropriate; and any site, subgroup, staffing, or cost information needed to judge feasibility.

What if the recruitment test misses its target?

Examine where the shortfall occurred and whether a credible modification can address it. Missing a target does not automatically require abandonment, but proceeding unchanged should be justified if the feasibility evidence indicates that the main study's recruitment requirement is unlikely to be met.

Can recruitment feasibility be tested as part of an internal pilot?

Yes, in some study designs an internal pilot can assess recruitment and other feasibility parameters while contributing eligible data to the main study if progression criteria are met. Whether this approach is appropriate depends on the design, prespecified decision rules, analysis plan, and applicable ethical and regulatory requirements.

Should I test eligibility and participant willingness separately?

You can estimate them separately because they represent different recruitment stages, but a recruitment feasibility assessment often benefits from observing the entire pathway. If eligibility is especially uncertain, first estimate how many screened people are likely to qualify; if enrollment is the concern, examine how many eligible people actually proceed to participation.

09 · The Bottom Line

Test recruitment when the study depends on an uncertain recruitment assumption

The Bottom Line

You should consider testing recruitment feasibility before finalizing a study when recruitment is a consequential unresolved uncertainty and the study could fail if the proposed pathway cannot deliver the required sample at the required pace.

Design the test around the decision you need to make, track the stages that explain recruitment performance, and compare the results with what the full study actually requires. The goal is not to prove that recruitment is possible, but to determine whether the planned recruitment system is plausible enough to support the study.

10 · Sources and Further Reading

Sources and further reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes