03 · What You Need to Know
How to Evaluate Recruitment Feasibility Before the Definitive Study
What Does Pilot Testing Recruitment Mean?
Pilot testing recruitment involves implementing proposed recruitment procedures on a limited scale to assess whether they are practical and capable of producing an adequate participant sample.
The pilot may examine how potential participants are identified, contacted, screened, informed, and enrolled.
For example, a researcher planning a study of university teachers' use of generative AI might test whether institutional email invitations reach eligible teachers and whether recipients are willing to participate in interviews.
The pilot could identify problems involving access permissions, unclear invitation language, eligibility screening, or scheduling.
The purpose is to obtain evidence about recruitment procedures, not merely to demonstrate that some individuals can be recruited.
When Is Recruitment Piloting Particularly Important?
Recruitment piloting may be especially valuable when the target population is difficult to access, eligibility criteria are restrictive, participation requires substantial time, or recruitment depends on unfamiliar institutions or intermediaries.
It may also be important when the definitive study requires a large sample within a limited period or when recruitment failure would make the research question impossible to answer adequately.
For example, a longitudinal educational intervention may require students to participate throughout an academic term. Initial willingness may not translate into completed enrollment when students learn the full participation requirements.
Similarly, recruiting teachers during examination periods may produce different responses from recruitment during less demanding parts of the academic calendar.
The need for a pilot depends on how much relevant recruitment evidence already exists and whether the proposed conditions differ from those previously studied.
When Might Recruitment Piloting Be Unnecessary?
A separate recruitment pilot may be unnecessary when the study uses an established recruitment pathway with credible evidence of sufficient eligibility and enrollment under comparable conditions.
For example, a research team may have recently conducted similar studies in the same institutions using comparable eligibility criteria and participation requirements.
However, prior success should not be assumed to transfer automatically when the new study involves more sensitive questions, greater participant burden, or different recruitment periods.
Researchers should evaluate the relevance of existing evidence rather than treating previous recruitment rates as guaranteed future outcomes.
A focused feasibility assessment may be sufficient when only one aspect of recruitment remains uncertain.
Which Parts of Recruitment Can Be Pilot-Tested?
Recruitment involves several connected procedures, each of which may create barriers.
| Recruitment procedure |
What the pilot can assess |
Potential problem |
| Population identification |
Whether eligible individuals can be identified through the proposed sources |
Available lists may not adequately represent the target population. |
| Institutional access |
Whether required permissions and recruitment channels are workable |
Approval or administrative coordination may take longer than expected. |
| Participant invitation |
Whether invitations reach recipients and communicate the study clearly |
Messages may be overlooked or misunderstood. |
| Eligibility screening |
Whether criteria can be applied consistently and efficiently |
Screening may exclude more individuals than anticipated. |
| Consent and enrollment |
Whether eligible individuals understand participation and complete enrollment |
Participants may decline after learning the full requirements. |
| Scheduling |
Whether participants can attend interviews, assessments, or intervention activities |
Academic schedules may create substantial conflicts. |
| Recruitment monitoring |
Whether recruitment records are accurate and sufficiently detailed |
Duplicate invitations or incomplete records may distort estimates. |
The pilot should focus on procedures that create consequential uncertainty rather than testing every administrative activity with equal intensity.
What Is Recruitment Rate?
Recruitment rate can refer to different quantities, so researchers should define it explicitly.
It may describe the number of participants enrolled per unit of time, the proportion of invited individuals who enroll, or the proportion of eligible individuals who consent.
These measures answer different feasibility questions.
For example, enrolling 30 participants in one month describes recruitment speed, but it does not reveal how many individuals were approached or screened.
Similarly, a high enrollment proportion among eligible individuals may coexist with a low eligibility yield from the original population.
Researchers should report the numerator, denominator, and relevant time period for each recruitment indicator.
How Do You Calculate Recruitment Yield?
Recruitment yield can be expressed as the proportion of approached individuals who ultimately enroll, provided the approached population is clearly defined and records are sufficiently complete.
The calculation is straightforward, but interpretation depends on whether the denominator includes unique individuals, delivered invitations, or another clearly defined recruitment unit.
For open advertisements, the number of people who actually encountered an invitation may be unknown. Researchers should not invent a denominator or interpret website impressions as equivalent to unique eligible individuals.
How Is Eligibility Yield Different From Enrollment Rate?
Eligibility yield concerns the proportion of screened individuals who meet the inclusion criteria.
Enrollment rate may concern the proportion of eligible individuals who agree to participate.
For example, 100 individuals may complete screening, 60 may be eligible, and 45 may enroll.
The eligibility yield is 60 of 100, or 60%. The enrollment proportion among eligible individuals is 45 of 60, or 75%.
These results indicate different aspects of recruitment feasibility.
A low eligibility yield may suggest that recruitment channels are reaching many unsuitable individuals. A low enrollment proportion among eligible individuals may indicate concerns about participation burden, communication, or willingness.
Researchers should not combine these explanations without examining the actual recruitment records.
Why Is Recruitment Speed Important?
Recruitment speed helps determine whether the definitive study can enroll the required sample within its available timeline.
For example, a pilot may enroll 15 participants over three weeks, suggesting an observed average of five participants per week.
However, projecting this rate across a much longer period assumes that recruitment conditions remain sufficiently stable.
Recruitment may slow as easily accessible participants are exhausted or as academic schedules change.
Rates may also differ when the definitive study expands to additional sites.
Researchers should therefore use pilot recruitment speed as a planning estimate rather than a guaranteed future rate.
Should Recruitment Channels Be Compared?
Comparing recruitment channels can be useful when the definitive study may use several approaches.
For example, a university study might recruit through institutional email, learning management system announcements, and department coordinators.
The pilot can record the number of eligible participants enrolled through each channel, the time required, and relevant administrative costs.
However, comparisons may be affected by differences in the populations reached.
A channel with a higher enrollment proportion is not automatically superior if it systematically excludes important participant groups.
Researchers should consider recruitment efficiency alongside sample composition and equitable access.
Should Eligibility Criteria Be Tested?
Yes, when there is uncertainty about whether the criteria can be applied consistently or whether sufficient eligible participants exist.
For example, a study may require teachers to have used generative AI for a specified instructional purpose during the previous academic term.
A pilot may reveal that potential participants interpret the eligibility requirement differently.
Researchers could then clarify the screening questions or operational definitions.
However, changing eligibility criteria can alter the population to which the definitive study applies.
Any modification should be justified by the research question and assessed for ethical and methodological implications rather than made solely to increase enrollment.
Should Recruitment Materials Be Pretested?
Recruitment messages should communicate the study purpose, eligibility, participation requirements, and relevant protections accurately.
A pretest can identify unclear wording, excessive length, inaccessible formats, or misleading descriptions.
For example, an invitation describing a study as a short interview may be misleading if participants are also expected to complete repeated questionnaires.
Researchers should examine whether prospective participants understand the actual requirements.
However, recruitment materials should not be optimized through exaggerated benefits or undue pressure.
Clarity and voluntariness are more important than maximizing enrollment at any cost.
How Does Recruitment Piloting Relate to Informed Consent?
Recruitment and consent are connected but distinct processes.
Recruitment concerns identifying and inviting potential participants. Informed consent concerns ensuring that eligible individuals receive appropriate information and voluntarily agree to participate.
A recruitment pilot may reveal that participants misunderstand the study or withdraw interest after reviewing consent materials.
Such findings may indicate that recruitment messages are incomplete or that the participation requirements are burdensome.
However, a high consent rate does not establish that participants understood the study.
Where uncertainty concerns comprehension or voluntariness, pilot testing informed consent procedures may require additional methods beyond monitoring enrollment.
What Ethical Risks Can Recruitment Piloting Reveal?
Recruitment procedures may create risks involving privacy, coercion, unequal access, or inappropriate disclosure of eligibility information.
For example, students recruited by their own teachers may perceive participation as connected to academic evaluation.
Employees approached through supervisors may similarly feel pressure to participate.
Researchers should establish safeguards that protect voluntary participation and minimize inappropriate influence.
A pilot may reveal whether recruitment arrangements are confusing or uncomfortable, but ethical protections should be incorporated before testing begins.
Researchers must follow applicable institutional review and approval requirements.
How Should Recruitment Burden Be Assessed?
Recruitment burden includes the time and effort required from participants, researchers, institutional staff, and intermediaries.
For example, a study may require repeated reminders, individual screening appointments, and substantial administrative coordination.
Even if recruitment targets are achieved, the procedure may be too resource-intensive for the definitive study.
A pilot can document staff time, communication volume, scheduling difficulties, and other relevant resource demands.
These findings can inform more realistic staffing and timeline estimates.
Can Recruitment Piloting Reveal Selection Bias?
A pilot may identify differences between individuals who enroll and those who decline or remain unreachable, when appropriate information is available.
For example, recruitment through online announcements may disproportionately reach students who regularly access institutional digital platforms.
However, researchers should not assume that observed differences fully characterize selection bias.
Information about nonparticipants may be limited, and privacy requirements may restrict what can be collected.
Where feasible, researchers should examine whether recruitment procedures systematically underrepresent groups important to the research question.
Recruitment efficiency should not be evaluated independently of sample adequacy.
How Should Recruitment Be Piloted in Qualitative Research?
Qualitative studies may prioritize access to information-rich participants, relevant experiences, and variation rather than statistical representativeness.
A recruitment pilot may assess whether the proposed purposive sampling criteria identify appropriate participants and whether access to the intended settings is feasible.
For example, a qualitative study of teachers' experiences implementing AI policies may need participants from institutions with different policy arrangements.
The pilot could identify whether these contexts are accessible and whether recruitment procedures permit meaningful variation.
However, the number of initial interviews alone does not establish qualitative sample adequacy.
The sampling logic should remain consistent with the selected qualitative methodology.
How Should Recruitment Be Piloted in Mixed-Methods Research?
Mixed-methods recruitment may require relationships between quantitative and qualitative samples.
For example, an explanatory sequential study may need to invite selected survey respondents for follow-up interviews based on their quantitative profiles.
The pilot can examine whether the consent and recontact arrangements permit appropriate linkage.
It may also assess whether enough respondents from relevant profiles are willing to participate in the qualitative phase.
However, a recruitment pilot should not assume that independently recruited interview participants can explain the experiences of specific survey respondents without an appropriate connection.
Sampling integration requirements should be considered before the relevant data are collected.
How Large Should a Recruitment Pilot Be?
There is no universal sample size for recruitment piloting.
The appropriate scope depends on whether the objective is to identify obvious procedural problems, estimate recruitment rates, compare recruitment channels, or assess eligibility yield with useful precision.
For example, a small pretest may identify confusing invitation language, while estimating enrollment rates precisely may require a larger number of approached individuals.
Researchers should justify the pilot scope according to the decision the findings must inform.
They should also consider whether the recruitment period is sufficiently representative of the intended definitive study conditions.
What Progression Criteria Should Be Used?
Progression criteria should reflect the recruitment requirements of the definitive study.
For example, a study may need to enroll a specified number of participants per month to complete data collection within its available timeline.
Researchers can establish criteria for proceeding, modifying recruitment, or reconsidering feasibility.
However, thresholds should be justified rather than selected arbitrarily.
Observed recruitment estimates also contain uncertainty, and decisions should consider whether barriers are remediable.
A low recruitment rate may support redesign rather than immediate abandonment when the pilot identifies practical improvements.
What If Recruitment Is Lower Than Expected?
Researchers should investigate where participants are lost in the recruitment process.
A low enrollment total may reflect insufficient reach, low eligibility yield, unclear invitations, participant burden, or scheduling difficulties.
Each explanation suggests a different response.
For example, expanding recruitment channels may address limited reach, while revising screening language may address confusion about eligibility.
Reducing participant burden may improve willingness, but substantive changes to the study procedures should be assessed carefully.
Researchers should not simply lower eligibility standards or apply greater pressure to participants to achieve a target.
Can Recruitment Procedures Be Changed After a Pilot?
Yes. Improving recruitment procedures is a legitimate use of pilot findings.
Researchers may revise invitation materials, recruitment timing, contact procedures, or administrative coordination.
However, changes affecting eligibility, consent, participant risks, or approved recruitment methods may require ethics review or amendment.
Substantial modifications may also affect the relevance of the original pilot estimates.
For example, a recruitment rate observed through institutional email may not predict the rate achieved through an entirely different community recruitment strategy.
Can Pilot Participants Be Included in the Definitive Study?
Sometimes, depending on whether the pilot is internal or external and whether the procedures remain compatible.
Researchers should consider consent arrangements, eligibility criteria, data comparability, and any changes made after the pilot.
Recruitment pilots may also involve individuals who were approached but not enrolled. Their information should be handled according to the approved protocol and applicable privacy requirements.
Researchers should not assume that pilot participation automatically authorizes inclusion in a later study.
How Should Recruitment Pilot Findings Be Reported?
The report should describe recruitment channels, eligibility criteria, numbers approached, numbers screened, numbers eligible, numbers enrolled, and relevant time periods, where these quantities can be established.
Researchers should explain the denominators used for recruitment proportions and identify missing or uncertain information.
They should also report practical barriers, participant concerns, resource demands, and consequential changes recommended for the definitive study.
Where progression criteria were established, the report should explain how the observed evidence informed the decision.
Recruitment findings should be interpreted as context-dependent feasibility evidence rather than guaranteed predictions of future enrollment.
Watch Out
Do not assume that access to a large population guarantees adequate recruitment. The number of potentially eligible individuals, the proportion reached, the proportion willing to participate, and the speed of enrollment are different quantities that should be assessed separately.
