03 · What You Need to Know
A Practical Framework for Selecting a Non-Probability Sampling Method
Start with the Inference Your Study Needs to Make
The most consequential sampling decision occurs before recruitment: determining what the study is intended to establish.
A feasibility study may ask whether students can complete an AI-supported assessment activity within an allotted period. A qualitative study may investigate how teachers negotiate institutional AI policies. An exploratory survey may compare the reported experiences of participants recruited across several academic programs.
These objectives require different kinds of evidence. A feasibility study may need participants who can test a procedure, while an interpretive study may need people who have experienced the phenomenon directly.
By contrast, estimating the percentage of all university students who use generative AI requires a defensible connection between the sample and the target population. Ordinary non-probability recruitment generally does not provide that connection through known inclusion probabilities.
Before choosing a method, distinguish whether your intended claims concern the recruited participants, a bounded setting, an analytical process, a theoretical explanation, or a wider population parameter.
How Do the Main Non-Probability Sampling Methods Differ?
The following comparison identifies the principal selection logic of five commonly used methods.
| Method |
Principal selection logic |
Potentially appropriate objective |
Main limitation |
| Convenience |
Recruit accessible or available participants |
Pretesting, feasibility, or preliminary investigation |
Accessibility-related selection |
| Purposive |
Select cases with relevant experiences or characteristics |
Understanding particular processes or perspectives |
Judgment-dependent coverage of relevant cases |
| Snowball |
Identify participants through referrals |
Accessing difficult-to-identify or networked populations |
Network concentration and homophily |
| Quota |
Recruit specified numbers from defined categories |
Ensuring observations across important groups |
Uncontrolled selection within quota categories |
| Consecutive |
Invite every eligible encountered case during a defined sequence |
Systematic recruitment from an institutional or service-based case stream |
Setting, timing, and participation-related selection |
These categories describe recruitment principles rather than mutually exclusive research designs. A researcher might use purposive eligibility criteria, snowball referrals, and quotas for particular participant characteristics within the same study.
When methods are combined, each component should have a clear purpose and be described accurately.
When Should You Choose Convenience Sampling?
Convenience sampling may be defensible when accessible participants can provide the evidence needed for a bounded or preliminary objective.
For example, a researcher testing an AI-supported questionnaire may recruit students from an accessible course section to identify unclear instructions, software problems, and completion difficulties.
The justification rests on the purpose of the exercise. The study is evaluating the functioning of the instrument under specified conditions, not estimating how all students would respond.
Convenience sampling becomes harder to defend when the researcher intends to make broad population claims or when accessibility systematically excludes participants essential to understanding the phenomenon.
Its limitations should therefore shape the research question, analysis, and conclusions.
When Should You Choose Purposive Sampling?
Purposive sampling is appropriate when the research requires cases possessing particular experiences, knowledge, or circumstances.
Suppose a qualitative study investigates how faculty members resolve disagreements about acceptable AI assistance in student assessment. Participants should have directly encountered relevant decisions or disputes.
Recruiting arbitrary faculty members merely because they are accessible may produce limited information. Purposive criteria allow the researcher to select participants whose experiences can address the research question.
Different purposive strategies may emphasize shared characteristics, contrasting cases, specialist knowledge, or theoretically important experiences.
However, researchers should avoid selecting only participants likely to confirm an anticipated explanation. Selection criteria and changes during recruitment should remain transparent.
When Should You Choose Snowball Sampling?
Snowball sampling may be useful when eligible participants cannot readily be identified through institutional records or public recruitment channels.
For example, educators who participate in informal AI-related professional learning networks may be identified through referrals from other participants.
Referrals can provide access to people whose relevant experiences are not documented in an official registry. They may also help researchers reach communities in which trust influences willingness to participate.
However, recruitment through personal or professional networks may overrepresent highly connected individuals or people sharing similar perspectives.
Researchers should consider multiple entry points, independent eligibility screening, confidentiality safeguards, and the possibility that important networks remain inaccessible.
Ordinary snowball sampling should not be confused with specialized respondent-driven sampling procedures or their associated estimation assumptions.
When Should You Choose Quota Sampling?
Quota sampling may be appropriate when the study needs specified numbers of observations from important population categories but cannot implement probability selection.
For example, an exploratory survey might require sufficient responses from engineering, business, and humanities students to examine differences in their reported AI learning experiences.
Quotas can prevent one accessible category from dominating recruitment. They may follow known population proportions or deliberately allocate more observations to analytically important groups.
However, participants within each quota category may still enter through voluntary response or convenience recruitment.
Matching the sample to population proportions on a few variables does not guarantee similarity on unmeasured characteristics.
Quota sampling is therefore most defensible when controlled group recruitment serves an identifiable analytical purpose and the study does not equate quota compliance with statistical representativeness.
When Should You Choose Consecutive Sampling?
Consecutive sampling may be preferable when eligible cases appear through a definable institutional, clinical, educational, or service-based process.
For example, researchers evaluating a digital learning support center could invite every eligible student using the service during a specified six-week period.
The systematic invitation rule reduces discretion over which encountered cases are approached.
However, students who never use the service remain outside the accessible case stream. Nonparticipation among invited students may introduce additional differences.
Consecutive recruitment can improve procedural coverage within the defined setting without establishing that the observed participants represent a wider population.
Can More Than One Non-Probability Sampling Method Be Used?
Yes. Combining methods may be appropriate when different recruitment problems require different solutions.
A qualitative study might purposively define eligible participants as teachers who have implemented AI-supported assessment, use referrals to locate them, and seek variation across institutional sectors.
An exploratory survey might recruit accessible students while setting quotas for academic programs.
Such combinations should not be described as though they eliminate the limitations of their component methods.
For example, adding quotas to convenience recruitment does not establish random selection within quota categories. Likewise, recruiting purposively eligible participants through referrals does not establish known population inclusion probabilities.
Researchers should report the actual selection sequence and explain what each component contributes.
How Should Population Coverage Influence Your Choice?
Every recruitment procedure creates opportunities for some eligible people to participate while making participation difficult or impossible for others.
Online recruitment may exclude people with limited connectivity. Institution-based recruitment may exclude individuals outside participating organizations. Professional referrals may miss people who are socially disconnected from established networks.
These exclusions matter when they are related to the research outcomes or when they remove perspectives essential to the study.
Researchers should identify the accessible population, recruitment channels, eligibility restrictions, and likely exclusions before collecting data.
Where feasible, additional recruitment channels or settings may broaden coverage. Nevertheless, expanding recruitment does not automatically establish probability sampling.
How Should Sample Size Be Determined?
Non-probability sampling does not have one universal sample size rule.
For feasibility studies, sample size may depend on the operational problems the researcher needs to detect and the precision required for feasibility indicators.
For qualitative inquiry, adequacy may depend on the specificity of participants, analytical approach, quality of data, and intended depth of interpretation. Information power and other methodology-specific considerations may be relevant.
For quantitative comparisons, statistical power or precision calculations may still be useful under explicitly stated modeling assumptions.
However, calculating a sample size does not establish population representativeness. A sufficiently large non-probability sample can still contain substantial selection bias.
The sample size justification should therefore distinguish analytical adequacy from the validity of broader population inference.
Can Non-Probability Sampling Support Statistical Analysis?
Yes. Non-probability samples can support descriptive analysis of observed participants, qualitative interpretation, and some model-based statistical analyses.
However, the meaning of the results depends on the research design and assumptions.
A regression model fitted to a convenience sample may describe associations among the observed respondents. Whether those associations extend to a wider population requires additional reasoning about selection and model validity.
Similarly, a quota sample may contain enough participants for a statistical comparison without providing a probability-based estimate of the corresponding population difference.
Researchers should not interpret conventional p-values or confidence intervals as proof that the recruitment process supports generalization.
Statistical analysis and sampling-based inference are related but distinct methodological concerns.
Can Weighting Make a Non-Probability Sample Representative?
Weighting and calibration may reduce discrepancies between a non-probability sample and known population characteristics under appropriate assumptions.
For example, researchers may adjust a sample to match known distributions of age, institutional sector, or geographical region.
However, the effectiveness of such adjustments depends on whether the variables used adequately account for the selection process and relevant outcomes.
Unobserved differences between participants and nonparticipants may remain.
Weights constructed for non-probability samples should not automatically be treated as inverse-probability design weights derived from known selection probabilities.
The AAPOR Task Force on Non-Probability Sampling emphasizes that the quality of non-probability estimates depends on the recruitment process, auxiliary information, and assumptions underlying the estimation method.
Researchers should therefore distinguish improved demographic alignment from demonstrated population representativeness.
What Ethical Considerations Affect Sampling-Method Selection?
Sampling decisions can influence privacy, voluntariness, and equitable opportunities for participation.
Convenience recruitment from classes taught by the researcher may create perceived pressure to participate. Snowball recruitment can disclose sensitive information about people who have not consented. Quota recruitment may require collecting personal characteristics that are not otherwise necessary.
Researchers should consider power relationships, institutional permissions, confidentiality, and appropriate data minimization when selecting recruitment procedures.
A method that is operationally convenient may still be inappropriate if it introduces avoidable coercion or privacy risks.
Ethical safeguards should be designed alongside the sampling strategy rather than added after participants have been identified.
How Should the Sampling Method Be Justified?
A defensible justification should explain the connection between the research objective and the recruitment procedure.
It should identify who was eligible, how participants were approached or identified, why the chosen method was appropriate, and which population groups or perspectives may have been missed.
For qualitative studies, reporting frameworks such as COREQ and the Standards for Reporting Qualitative Research can support transparent descriptions of participant selection and research context.
For non-probability surveys, AAPOR's transparency and reporting guidance provides relevant considerations concerning recruitment, weighting, and the limitations of population inference.
The justification should not depend solely on the claim that probability sampling was too expensive. It should establish why the chosen non-probability procedure is capable of producing evidence relevant to the actual research question.