Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

When Does Expected Participant Attrition Make a Longitudinal Study Infeasible?

Expected attrition can make a longitudinal study infeasible when recruitment demands, missing outcome data, costs, or selection bias prevent the research question from being answered credibly. Learn how to evaluate these constraints, calculate realistic recruitment requirements, and decide when a study needs redesign rather than a larger initial sample.

744
Attrition and Longitudinal Study Feasibility Guide 744 of 1272
01 · The Question

At What Point Does Expected Dropout Make a Longitudinal Study Unrealistic?

You are planning a longitudinal study that will follow participants for two years. Your sample size calculation indicates that 300 participants must contribute information to the primary analysis. However, comparable studies suggest that a substantial proportion of participants may be unavailable at final follow-up.

Should you simply recruit more people? What if the required initial sample exceeds the accessible population, recruitment budget, or time available?

Even if recruitment is possible, another concern remains. Participants who discontinue may differ systematically from those who remain, particularly when dropout is related to the outcomes being studied.

The challenge is determining when attrition represents a manageable planning assumption and when it threatens the scientific or operational feasibility of the entire design.

02 · The Short Answer

Attrition Makes a Study Infeasible When Its Consequences Cannot Be Managed Credibly

In Brief

Expected participant attrition may make a longitudinal study infeasible when the recruitment required to preserve adequate information exceeds available resources or population access, when essential follow-up outcomes cannot realistically be obtained, or when likely selective missingness prevents sufficiently credible answers to the primary research question.

There is no universal attrition percentage at which a longitudinal study becomes infeasible. Feasibility depends on the estimand, statistical design, follow-up duration, available population, retention procedures, missing-data assumptions, and the scientific value of the outcomes that can realistically be measured.

03 · What You Need to Know

Evaluating Whether Longitudinal Research Remains Scientifically and Operationally Feasible

Feasibility Is More Than Achieving the Recruitment Target

Researchers sometimes define feasibility primarily in terms of whether enough participants can be enrolled.

For longitudinal research, recruitment is only one component. Participants must also provide sufficient information at scientifically meaningful time points.

A study might recruit its target sample successfully but fail to obtain enough primary outcome measurements. Another might achieve the planned number of final observations while experiencing selective attrition that seriously limits interpretation.

Feasibility should therefore be assessed across several connected dimensions.

Dimension Central question Potential feasibility concern
Recruitment Can enough eligible participants be enrolled? The required initial sample exceeds realistic recruitment capacity
Retention Can participants reasonably complete essential follow-up? Expected missingness is substantial at the primary endpoint
Statistical information Will the available observations support the planned analysis? Precision or power becomes inadequate
Validity Can the intended inference remain credible? Selective missingness threatens the estimate under plausible assumptions
Resources Can the study sustain recruitment and follow-up? Costs, staffing, or timelines exceed available resources
Ethics Are the burdens and risks justified by the expected scientific value? Participants face substantial demands with little prospect of an informative result

These dimensions should be evaluated together. A technically achievable recruitment target does not necessarily establish that the study is feasible as designed.

There Is No Universal Attrition Threshold for Infeasibility

It may be tempting to classify a study as feasible below a particular attrition percentage and infeasible above it.

However, such a rule would ignore important differences among research designs.

A study with 25% missing final outcomes may remain informative when the available repeated measurements support an appropriate analysis and the missing-data assumptions are defensible.

Another study with only 5% missing outcomes could experience consequential bias if nearly all missing participants belong to a small subgroup with substantially different outcomes.

Neither percentage independently determines feasibility.

The relevant issue is whether the study can still estimate its intended quantity with acceptable uncertainty and credibility.

Researchers should therefore avoid treating familiar attrition allowances as universal quality standards.

Start With the Primary Estimand and Essential Measurements

An estimand describes the quantity the research intends to estimate.

In longitudinal research, this may involve change over time, an outcome at a particular endpoint, or differences in trajectories between groups.

Attrition feasibility depends on which observations are necessary for that estimand.

For example, a study investigating students' academic engagement at graduation may depend heavily on obtaining measurements near graduation.

A study investigating average engagement trajectories across several semesters may use information from multiple assessment points, even when some participants miss particular measurements.

Researchers should distinguish missing one observation from losing all information contributed by a participant.

They should also consider whether later measurements can answer the original research question or whether a shorter follow-up would require changing the scientific objective.

Calculate the Recruitment Required Under Plausible Attrition Scenarios

A simplified planning calculation can help determine whether expected attrition creates an unrealistic recruitment requirement.

When a specified number of complete final outcomes is needed, the initial recruitment target can be estimated by dividing that number by the expected retention proportion.

How It Is Calculated
Required recruitment = Required complete outcomes ÷ (1 − Expected attrition proportion)
Required complete outcomes is the number needed for the specified analysis. Expected attrition is expressed as a proportion between zero and one. The result is rounded upward to a whole participant.
If 300 complete outcomes are required and expected attrition is 40%, the recruitment target is 300 ÷ 0.60 = 500 participants.

The calculation indicates that recruiting 500 participants would produce an expected 300 complete outcomes if the assumed retention proportion is realized.

It does not guarantee 300 outcomes, establish adequate power under every analytical model, or correct selective missingness.

For repeated-measures designs, clustered studies, survival analyses, or complex missing-data patterns, analysis-specific calculations or simulation may be necessary.

The distinction between a planning allowance and a realistic prediction is explained by estimating participant attrition using comparable evidence.

Compare Recruitment Requirements With the Accessible Population

A calculated recruitment target is useful only when it can plausibly be achieved.

Suppose a study requires 500 enrolled participants, but the participating institutions collectively have only 420 potentially eligible individuals.

Even if every eligible individual agreed to participate, the proposed recruitment target would remain unattainable.

In practice, eligibility confirmation, refusal, scheduling difficulties, and other recruitment barriers may further reduce enrollment.

Researchers should therefore distinguish the total population, the accessible eligible population, the number expected to receive invitations, and the number likely to enroll.

Expanding recruitment sites or channels may help, but only when those changes are feasible, approved, and compatible with the research question.

Additional recruitment should not be assumed to solve every limitation, particularly when new channels reach substantially different participant populations.

Recruitment Time and Follow-Up Time Must Be Considered Together

Longitudinal studies require enough time both to recruit participants and to observe them through the planned endpoint.

Staggered recruitment can create a feasibility problem when participants enrolled late cannot complete follow-up before funding or staffing ends.

For example, a study requiring eighteen months of observation cannot necessarily continue enrolling participants until the final month of a two-year project.

The timeline must accommodate the last participant's required follow-up, data processing, and analysis.

Researchers should examine recruitment rates, enrollment deadlines, expected assessment completion, and available project extensions.

A study may be feasible in terms of population size but infeasible within the funded period.

High Attrition Can Reduce Precision and Statistical Power

Missing outcomes generally reduce the amount of information available for estimating study parameters.

The effect on statistical power depends on the analysis, outcome variability, correlation among repeated measurements, group allocation, and missing-data pattern.

For a simplified analysis requiring complete final outcomes, fewer observed participants may directly reduce precision.

In repeated-measures models, partial observations may still contribute information, although the extent depends on the model and assumptions.

Researchers should not assume that every participant missing a final assessment contributes no useful information.

Likewise, they should not assume that modern missing-data methods preserve the original power automatically.

Simulation can be useful when simple calculations cannot adequately represent the anticipated data structure.

Selective Attrition Can Threaten Validity Even When Enough Participants Remain

A study may retain enough participants numerically while losing important information systematically.

Suppose researchers investigate changes in student well-being over two years. Students experiencing worsening difficulties may be less likely to complete later questionnaires.

If these students are disproportionately missing, the observed trajectories may appear more favorable than those of the original cohort.

Alternatively, participants whose circumstances improve may become less interested in follow-up, potentially producing a different distortion.

The direction of bias cannot be inferred from attrition alone.

Researchers should examine plausible relationships among missingness, observed characteristics, and unobserved outcomes.

The National Research Council's report on missing data in clinical trials emphasizes prevention, appropriate analytical assumptions, and sensitivity analyses. These principles are relevant when assessing whether longitudinal findings remain credible.

Recruiting more participants cannot automatically recover the outcomes of individuals who are systematically missing.

Missing-Data Methods Do Not Make Every Study Feasible

Likelihood-based models, multiple imputation, inverse probability weighting, and other methods may address incomplete data under particular assumptions.

For example, methods relying on missing-at-random assumptions require that the relevant missingness mechanism can be adequately explained by observed information, conditional on the model.

Such assumptions are generally not fully testable using observed data alone.

If missingness depends strongly on unobserved outcomes, the analysis may remain sensitive to assumptions that the available evidence cannot resolve.

Sensitivity analyses can investigate how conclusions change under alternative plausible assumptions.

However, if reasonable assumptions lead to substantially different substantive conclusions, the study may have limited ability to answer its primary question decisively.

Statistical sophistication cannot manufacture information that the research design has systematically failed to obtain.

Differential Attrition Can Complicate Group Comparisons

In comparative longitudinal studies, participants in different groups may have different probabilities of completing follow-up.

An intervention requiring additional activities may be more burdensome than the comparison condition. Participants experiencing unfavorable outcomes may also be more likely to discontinue particular interventions.

These mechanisms can create differential attrition.

However, identical attrition rates do not guarantee unbiased comparisons, and unequal rates do not independently prove bias.

Researchers should examine the missing-data mechanisms and whether the analysis remains appropriate for the intended estimand.

Planning comparable retention opportunities across study groups may reduce avoidable differences in outcome ascertainment.

Participant Burden Can Make Long-Term Follow-Up Unsustainable

A longitudinal design may require repeated questionnaires, interviews, physical assessments, or intervention-related activities.

Each procedure may be reasonable individually, but the cumulative burden can become substantial.

Participants may face competing responsibilities, financial costs, emotional demands, or accessibility barriers that make continued participation difficult.

Researchers should evaluate whether every measurement is necessary and whether the schedule can be simplified without compromising the research question.

Reducing unnecessary burden may improve feasibility more effectively than increasing the recruitment target.

However, reducing assessment frequency or shortening follow-up can change the scientific information obtained.

Such modifications should be justified by the study's objectives rather than introduced solely to achieve more favorable retention statistics.

Retention Strategies Can Improve Feasibility, but Their Effects Are Uncertain

Researchers may use reminders, flexible appointments, accessible assessment methods, reimbursement, or appropriate incentives to support continued participation.

Evidence reviews indicate that some retention interventions improve follow-up completion, while evidence for other strategies remains limited or context-dependent.

Researchers should not assume that introducing several retention strategies will reduce attrition to a predetermined level.

Instead, the study should use relevant evidence and, where feasible, pilot information to estimate what improvement is plausible.

Retention procedures should also preserve participant autonomy and avoid excessive contact or undue influence.

These considerations belong within the research protocol's retention plan.

When Does a Pilot Study Become Particularly Valuable?

A feasibility or pilot study may be especially useful when the population is difficult to follow, the proposed assessments are demanding, or comparable retention evidence is limited.

Such a study can examine recruitment rates, assessment completion, communication procedures, participant burden, and operational constraints.

However, small pilot samples produce uncertain attrition estimates.

A pilot showing 20% missing outcomes does not establish that the definitive study will experience exactly 20% attrition.

Researchers should use feasibility findings to refine procedures and evaluate plausible scenarios rather than treating preliminary estimates as precise predictions.

Prespecified progression criteria may help determine whether to proceed, modify the design, or discontinue development.

These criteria should reflect the study's scientific and operational requirements rather than arbitrary universal thresholds.

When Should Researchers Redesign Rather Than Recruit More?

Recruitment inflation may be reasonable when attrition is predictable, the required population is accessible, and the remaining missing-data concerns can be managed credibly.

Redesign becomes more appropriate when the required recruitment target is unattainable, follow-up demands are excessive, or essential outcomes are unlikely to be observed with sufficient validity.

Possible modifications include reducing unnecessary assessments, changing follow-up arrangements, expanding approved recruitment access, or reconsidering the duration of observation.

However, these changes may alter the research question or estimand.

For example, replacing a two-year outcome with a six-month outcome does not simply make the same study easier. It changes the period over which the phenomenon is evaluated.

Researchers should be explicit about the scientific trade-off rather than presenting a shorter study as equivalent to the original design.

When Might Discontinuing the Proposed Design Be Justified?

Sometimes no feasible modification can preserve the intended research objective.

A study may require a rare population that cannot be recruited in sufficient numbers. Essential long-term outcomes may occur beyond the available funding period. Participants may face burdens disproportionate to the expected scientific value.

Under such circumstances, proceeding with the original design may consume resources and impose participant demands without a reasonable prospect of producing informative evidence.

Researchers should consider alternative questions, designs, collaborations, or funding arrangements.

Abandoning an infeasible design is not necessarily abandoning the research problem. It may be the more responsible methodological decision.

Watch Out

Do not declare a longitudinal study feasible solely because a sample size inflation calculation produces a recruitment target. The calculation addresses expected numbers, not the credibility of missing-data assumptions, the accessibility of the required population, or the ethical sustainability of repeated follow-up.

04 · A Practical Example

When Attrition Makes a Two-Year Student Study Difficult to Complete

Hypothetical Example

Following Students Through Graduation and Early Employment

A university research team proposes a two-year longitudinal study examining changes in academic engagement and early employment experiences.

The planned primary analysis requires 300 participants with complete final-outcome measurements under the assumptions of its simplified sample size calculation.

Comparable evidence and preliminary feasibility information suggest that attrition might range from 20% to 40%.

The participating institutions can realistically recruit approximately 400 participants within the available enrollment period.

Evaluating Alternative Attrition Scenarios

Expected attrition Expected retention Required recruitment Within capacity of 400?
20% 80% 375 Yes
25% 75% 400 Yes, at the limit
30% 70% 429 No
35% 65% 462 No
40% 60% 500 No

These are hypothetical planning scenarios, not empirical predictions or universal feasibility thresholds.

At 30% expected attrition, the simplified calculation requires 429 participants, exceeding the accessible recruitment capacity.

At 40% expected attrition, the requirement increases to 500.

Deciding What to Change

Review the scientific objective. The team determines which outcomes genuinely require two years of follow-up and which intermediate measurements are essential.
Assess recruitment capacity. Researchers examine whether additional institutions could provide appropriate access without changing the intended population or introducing unacceptable operational complexity.
Investigate retention barriers. The team evaluates graduation-related email changes, relocation, assessment burden, and the feasibility of approved remote follow-up.
Reconsider the analysis. A statistician assesses whether the proposed repeated-measures analysis can use incomplete observations appropriately and whether simulation-based planning is warranted.
Evaluate validity and uncertainty. Researchers consider whether plausible selective missingness could materially change the conclusions even if sufficient numbers are obtained.
Make a progression decision. The team determines whether the original design is feasible, whether an amended design can preserve the research objective, or whether further feasibility work is necessary.

Suppose the team develops approved follow-up procedures that make 20% to 25% attrition plausible, although uncertain. The study may become operationally feasible within the available recruitment capacity.

However, if credible evidence continues to suggest attrition near 40%, recruiting 400 participants would be expected to yield only 240 complete final outcomes under the simplified assumptions.

The researchers should not describe that scenario as adequately powered merely because the initial enrollment target was reached.

Nor should they assume that the remaining 240 participants are free from selection bias.

The example illustrates why feasibility requires joint consideration of recruitment, retention, statistical information, and missing-data validity.

05 · What Researchers Often Get Wrong

Common Misconceptions About Attrition and Longitudinal Feasibility

Misconception

Attrition Above 20% Automatically Makes a Study Infeasible

No universal percentage determines feasibility. The consequences depend on the estimand, study design, available observations, missing-data mechanisms, and resources.

Misconception

Recruiting More Participants Always Solves Expected Dropout

Additional recruitment may preserve numbers but cannot guarantee adequate population access, affordable follow-up, or protection against selective missingness.

Misconception

Meeting the Final Sample Size Target Guarantees Valid Findings

A sufficient number of observed outcomes does not establish that missing participants are comparable to those retained. Selection bias can remain despite apparently adequate sample size.

Misconception

Missing-Data Methods Make High Attrition Unimportant

Analytical methods rely on assumptions and available information. They cannot guarantee recovery of unobserved outcomes or eliminate sensitivity to unmeasured missingness mechanisms.

Misconception

Shortening Follow-Up Preserves the Original Research Question

Changing the endpoint may alter the phenomenon or effect being estimated. A shorter study can be scientifically useful, but its objectives and claims must reflect the revised observation period.

Misconception

A Successful Pilot Guarantees Retention in the Definitive Study

Pilot estimates are uncertain and may not generalize to larger populations or different settings. Feasibility decisions should account for this uncertainty.

06 · What This Means for You

Make Feasibility a Decision About Credible Evidence, Not Just Enrollment Numbers

Begin with the primary research question and identify the follow-up information required to answer it.

Then compare plausible attrition scenarios with recruitment capacity, available resources, statistical requirements, and assumptions about missing outcomes.

A Simple Decision Framework

If expected attrition is modest and supported by comparable evidence
Use an appropriate recruitment allowance and implement a documented retention plan.
If the recruitment target exceeds the accessible population
Assess additional recruitment access or reconsider the design rather than assuming the target can be achieved.
If follow-up demands appear to drive substantial dropout
Review unnecessary assessments, accessibility barriers, and feasible alternatives while preserving the intended measurements.
If missingness may depend strongly on unobserved outcomes
Evaluate the credibility of analytical assumptions and conduct appropriate sensitivity assessments before claiming the design is sufficiently informative.
If plausible scenarios remain operationally or scientifically unacceptable
Consider further feasibility research, redesign, collaboration, or a different research question.

Researchers should document the assumptions supporting their progression decision, particularly when attrition estimates are uncertain.

Where participant burden is substantial, feasibility also requires considering whether the expected scientific value justifies asking individuals to undertake prolonged follow-up.

A study that cannot credibly answer its intended question should be reconsidered before participants and resources are committed unnecessarily.

07 · A Quick Checklist

Before Deciding Whether a Longitudinal Study Is Feasible

Before finalizing the study design, check:
Define the primary estimand and identify essential follow-up measurements.
Estimate attrition using comparable studies, feasibility evidence, and realistic participant circumstances.
Calculate recruitment requirements under several plausible attrition scenarios.
Compare recruitment targets with the accessible eligible population and expected enrollment rates.
Confirm that funding and staffing cover recruitment and the final participant's follow-up.
Assess statistical power or precision using methods appropriate to the planned analysis and missing-data pattern.
Evaluate plausible selective missingness and the assumptions required for valid inference.
Review participant burden and opportunities to improve retention without changing essential outcomes.
Establish justified criteria for proceeding, modifying, or discontinuing the proposed design.
08 · Frequently Asked Questions

Frequently Asked Questions About Attrition and Study Feasibility

What attrition rate makes a longitudinal study infeasible?

There is no universal threshold. Feasibility depends on recruitment capacity, required information, follow-up resources, missing-data mechanisms, and the intended inference.

Is 30% attrition too high for longitudinal research?

It may be consequential, but the percentage alone cannot determine whether the study is valid or feasible. Researchers should examine the outcomes missing, the characteristics of participants lost, and the assumptions supporting the analysis.

Can researchers simply increase sample size to compensate for high attrition?

Recruitment inflation may preserve expected numbers when sufficient participants and resources are available. It cannot automatically correct selective missingness or guarantee credible estimates.

Does a longitudinal study need complete data from every participant?

Not necessarily. Some analyses can use incomplete repeated measurements under appropriate assumptions. The information required depends on the estimand, design, and statistical model.

Can a pilot study establish whether retention is feasible?

A pilot can provide useful evidence about recruitment, follow-up, burden, and operational procedures. However, its estimates may be imprecise and should be considered alongside uncertainty and other relevant evidence.

Should researchers shorten follow-up when attrition is expected to be high?

Shorter follow-up may improve feasibility, but it can change the research question and miss important later outcomes. The scientific implications should be evaluated before modifying the endpoint.

Can multiple imputation make a high-attrition study feasible?

Multiple imputation may be useful under appropriate assumptions, but it cannot guarantee unbiased estimates when missingness depends on unobserved information. It should not substitute for feasible follow-up procedures.

When should researchers abandon a proposed longitudinal design?

Reconsideration is warranted when plausible recruitment, retention, resource, or validity constraints leave little reasonable prospect of answering the primary question. Alternative designs or research objectives may provide more informative and ethical options.

09 · The Bottom Line

Attrition Becomes a Feasibility Problem When the Study Can No Longer Answer Its Question Credibly

The Bottom Line

Expected participant attrition makes a longitudinal study potentially infeasible when the required recruitment and follow-up exceed realistic capacity, or when missing outcomes are likely to prevent sufficiently precise and credible answers to the primary research question.

Evaluate attrition through realistic scenarios, analysis-specific requirements, and plausible missing-data mechanisms. When the original design cannot be supported, reconsider recruitment, follow-up procedures, or the research objective rather than assuming that a larger sample or more complex statistical model will resolve the problem.

10 · Sources and Further Reading

Authoritative Sources on Longitudinal Feasibility and Missing Data

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes