Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Can Participant Incentives Improve Retention Without Introducing Bias?

Participant incentives may improve follow-up completion and reduce financial barriers, but they can also influence who remains in a study. Learn how to evaluate incentive effectiveness, distinguish reimbursement from compensation, and design ethically appropriate payment arrangements without assuming that higher retention eliminates bias.

743
Participant Incentives, Retention, and Bias Guide 743 of 1272
01 · The Question

Can Paying Participants Help You Retain Them Without Distorting Your Findings?

You are planning a longitudinal study that requires participants to complete several follow-up assessments. To reduce dropout, you consider offering a small payment for each completed questionnaire or a larger payment at the end of the study.

The arrangement seems reasonable. Participants contribute time and effort, and compensation may make continued participation more feasible. Yet payment can also influence decisions about enrollment, follow-up, and withdrawal.

Would incentives disproportionately retain participants with particular financial circumstances? Could a completion bonus encourage participants to continue despite discomfort? If more participants provide outcome data, does that necessarily mean the resulting estimates are less biased?

These questions require researchers to consider incentives as part of both the ethical relationship with participants and the methodological process through which observations become available.

02 · The Short Answer

Incentives May Improve Retention, but Bias Must Be Evaluated Separately

In Brief

Participant incentives can improve retention in some research settings by compensating time, reducing participation costs, or encouraging follow-up completion. However, incentives may also influence which participants enroll or remain available, and higher retention does not automatically establish that selection bias or missing-data bias has been reduced.

Appropriate incentives should be scientifically justified, proportionate to participation requirements, transparently communicated, and reviewed under applicable ethical requirements. Their effects depend on the incentive type, payment schedule, participant population, and reasons for missing follow-up.

03 · What You Need to Know

How Incentives Affect Retention, Participation Decisions, and Research Validity

What Counts as a Participant Incentive?

Researchers use several forms of financial and nonfinancial support to facilitate participation. Although these arrangements are sometimes collectively described as incentives, they serve different purposes.

Expense reimbursement Repayment of reasonable participation-related expenses, such as transportation or parking.
Compensation Payment recognizing the time, effort, inconvenience, or other contributions associated with research participation.
Participation incentive A benefit intended, at least partly, to encourage enrollment, completion of an assessment, or continued participation.

These categories may overlap. A fixed payment for completing a questionnaire can compensate participants' time while also encouraging response.

Nonfinancial arrangements, such as certificates or access to certain services, may also influence participation decisions. They should not automatically be regarded as ethically insignificant simply because no money changes hands.

Researchers should describe what participants will receive, when they will receive it, and which activities are associated with payment.

What Does Research Evidence Say About Incentives and Retention?

Systematic reviews of retention interventions in randomized trials provide evidence that some incentive arrangements can improve the availability of follow-up data. However, findings vary across incentive types, populations, study settings, and outcomes.

Brueton and colleagues' Cochrane review examined strategies intended to improve retention in randomized trials, including financial incentives and other approaches. The review found evidence supporting certain incentive strategies, while evidence for many other retention interventions was limited or uncertain.

The findings should not be interpreted as demonstrating that any payment amount, incentive schedule, or nonfinancial reward will improve retention in every study.

Evidence from survey methodology also indicates that incentives can affect response behavior, although survey response and longitudinal trial retention are not identical outcomes.

Researchers should therefore seek evidence from studies with comparable participants, assessment demands, and follow-up arrangements.

An incentive that improves completion of a brief postal questionnaire may not have the same effect on repeated clinical assessments or demanding qualitative interviews.

Incentives Can Reduce Practical Barriers to Participation

Some participants face direct costs when completing follow-up assessments.

These may include transportation expenses, mobile data charges, parking fees, childcare arrangements, or time away from paid employment.

Such costs can affect whether individuals are able to continue, even when they remain interested in the research.

Reimbursement or appropriate compensation may reduce these barriers and make participation more feasible.

For example, reimbursing travel expenses may help participants attend follow-up appointments that would otherwise impose substantial financial costs.

However, researchers should distinguish reducing an access barrier from demonstrating that an incentive has corrected selection bias.

Participants may differ in other ways that remain unmeasured, and reimbursement may not resolve scheduling, accessibility, or trust-related barriers.

Incentives Can Change the Composition of the Retained Sample

An incentive may influence some participants more strongly than others.

For example, a payment may be more consequential to someone with limited disposable income than to someone who faces few financial constraints.

Alternatively, an incentive may particularly attract individuals who have sufficient time to complete repeated assessments but would otherwise consider participation insufficiently rewarding.

These differences can change which participants remain available for analysis.

Whether the change reduces or increases bias depends on how incentive responsiveness relates to the study's outcomes and target population.

Consider a study of financial well-being. If compensation changes follow-up participation differently across financial circumstances, the retained sample may differ from the original cohort in characteristics directly relevant to the outcome.

That does not mean compensation is inappropriate. It means researchers should consider its possible selection effects rather than treating improved retention as an unqualified methodological benefit.

Higher Retention Is Not the Same as Lower Attrition Bias

Retention rate describes the proportion of participants who remain available for a specified assessment or other defined research activity.

Attrition bias concerns whether missing observations systematically distort the intended estimate.

These are related but distinct.

Suppose an incentive increases follow-up completion from 75% to 90%. The additional observations may improve precision and reduce the amount of missing information.

However, the remaining 10% may still differ systematically from those observed. The incentive may also have attracted additional participants with particular characteristics.

Conversely, a modest increase in retention could substantially improve an estimate if it reaches a subgroup that was previously underrepresented.

The direction and magnitude of bias cannot be inferred from the retention percentage alone.

This distinction is central when estimating expected attrition during study planning.

Payment Timing Can Influence Participant Decisions

Researchers may provide incentives at enrollment, after individual assessments, at specified milestones, or upon completion of the study.

Each arrangement creates different practical and ethical considerations.

Payment arrangement Potential advantage Important consideration
Payment after each completed assessment Recognizes contributions throughout follow-up May influence which assessments participants complete
Prorated compensation Allows payment for completed activities without requiring full study completion Requires clear rules for partial participation
Final completion bonus May encourage continued follow-up Could create pressure to remain enrolled or disadvantage those who withdraw
Expense reimbursement Reduces direct financial barriers Requires transparent eligibility and reimbursement procedures
Nonfinancial recognition May be suitable for some research contexts Value and attractiveness may vary across participant groups

No arrangement is universally optimal.

The U.S. Food and Drug Administration's guidance on payment and reimbursement to research subjects distinguishes payment arrangements from coercion and emphasizes institutional review of payment amounts and schedules. It also recommends that payment generally accrue as participation progresses rather than being made entirely contingent on study completion.

These recommendations arise in the context of FDA-regulated clinical investigations and should not be presented as a universal legal rule for every research setting.

Nevertheless, they provide a useful framework for considering whether payment arrangements place unnecessary pressure on participants.

Can Incentives Create Undue Influence?

Undue influence concerns circumstances in which an offer may compromise the voluntariness or appropriateness of a participation decision.

Payment is not inherently coercive. An offer of money is different from a threat of harm for refusing participation.

However, substantial incentives may raise concerns when participants are asked to accept significant risks or burdens, particularly if the offer could lead them to discount information relevant to their decision.

The appropriate assessment depends on the study's risks, participant circumstances, payment structure, and applicable ethical requirements.

Researchers should avoid assuming that a particular amount is universally acceptable or unacceptable.

Ethics review should consider the entire arrangement, including what participants must do to receive payment and what happens if they discontinue participation.

Incentives Should Not Make Withdrawal Financially Punitive

Participants should understand whether they will receive compensation for activities already completed if they withdraw before the final assessment.

A payment arrangement that withholds all compensation unless the entire study is completed may create unnecessary pressure to remain enrolled.

Prorated payment can be appropriate in many settings because it recognizes completed participation without making the full amount dependent on continued enrollment.

However, payment procedures must follow the approved protocol and applicable institutional requirements.

Researchers should distinguish compensation already earned from payments associated with activities that have not occurred.

Withdrawal should not be presented as misconduct or as a failure to fulfill an obligation to the research team.

Should Incentives Be Identical Across Study Groups?

In comparative research, differences in compensation may influence follow-up availability.

For example, participants in one intervention group may face additional travel costs because the intervention requires more visits.

Reimbursing those expenses may be appropriate even when the comparison group incurs fewer costs.

However, offering substantially different rewards for completing the same outcome assessment may create unequal retention incentives.

Researchers should distinguish justified reimbursement from differential encouragement to provide outcome data.

The issue is related to maintaining comparable retention opportunities across study groups.

Any group-specific payment arrangements should be specified in the protocol and considered in the interpretation of differential attrition.

Incentives May Affect Responses as Well as Completion

Incentives are commonly evaluated by whether participants complete assessments. Researchers should also consider whether payment arrangements might influence response behavior.

For example, participants may rush through a questionnaire if payment is associated only with submission rather than thoughtful completion.

Others may believe that favorable responses are expected, particularly if compensation is presented by a person with authority over them.

These effects are possible rather than inevitable.

Researchers should avoid linking payment to particular answers or outcomes and should communicate that compensation does not depend on providing favorable responses.

Data-quality procedures should be appropriate to the study and should not penalize participants for legitimate responses that differ from researchers' expectations.

Incentive Effects May Differ Between Recruitment and Retention

An incentive offered at enrollment may influence who initially volunteers.

An incentive introduced at a later follow-up may influence which already enrolled participants provide additional data.

These are different selection processes.

For example, a study that advertises substantial compensation from the beginning may attract a different sample from one that offers modest reimbursement and later introduces an approved follow-up incentive.

Researchers should not assume that evidence about recruitment incentives applies directly to retention incentives.

Changes made during follow-up can also complicate interpretation if they coincide with changes in the participant population or study procedures.

Where possible, incentive arrangements should be established before recruitment and evaluated as part of the retention plan.

Should Researchers Increase Incentives When Retention Falls?

Unexpected attrition may lead researchers to consider increasing compensation.

Before doing so, they should investigate why participants are missing assessments.

If the main barrier is transportation cost, reimbursement may be more appropriate than an unrelated completion bonus. If participants are experiencing questionnaire fatigue, additional payment may not address the underlying burden.

Researchers should also consider whether the change could produce differential participation across study groups or assessment periods.

Material modifications may require ethics approval or a protocol amendment.

The appropriate response should follow the underlying retention problem rather than assuming that more money is always the solution.

How Can Researchers Evaluate Whether Incentives Improve Retention?

Researchers may compare follow-up completion before and after an incentive change or examine differences between participants receiving different approved arrangements.

However, observational comparisons can be misleading.

For example, incentives may be offered preferentially to participants who are already difficult to retain. Their lower completion rate would not establish that incentives are ineffective.

Similarly, completion may improve after incentives are introduced because assessment burden or participant circumstances changed at the same time.

When the effect of an incentive is itself an important research question, an appropriately designed randomized evaluation of ethically acceptable retention strategies may provide stronger evidence.

Such evaluations should consider retention, participant experience, cost, and potential differences in sample composition.

Incentives Should Be Integrated With Other Retention Strategies

Compensation cannot substitute for accessible assessments, respectful communication, realistic scheduling, or appropriate privacy safeguards.

A participant may value an incentive but still be unable to attend an appointment because of work commitments or health circumstances.

Researchers should therefore consider incentives alongside the broader retention strategy specified in the research protocol.

The protocol should identify the incentive amount or form, payment schedule, eligibility conditions, administrative responsibilities, and procedures for participants who discontinue.

It should also establish how payment information will be managed securely and whether collection of identifying financial information is necessary.

These arrangements should be proportionate to the study and consistent with applicable institutional and legal requirements.

Watch Out

Do not use a higher retention rate as proof that an incentive has eliminated bias. Evaluate who remains missing, whether payment changes participation patterns, and whether the arrangement preserves meaningful freedom to decline or withdraw.

04 · A Practical Example

Comparing Retention With and Without a Follow-Up Incentive

Hypothetical Example

A Six-Month Study of Student Learning Experiences

A research team follows 300 undergraduate students for six months. Participants complete questionnaires at baseline, three months, and six months.

The researchers consider offering a modest payment for completing the final questionnaire.

To illustrate the methodological issue, suppose an appropriately approved randomized retention-methods evaluation assigns 150 participants to receive the incentive offer and 150 to receive the usual follow-up arrangements.

Both groups receive the same questionnaire and routine reminder schedule.

Calculating the Retention Difference

Assume the following hypothetical results.

Retention arrangement Participants Completed final assessment Completion rate
Incentive offered 150 135 90%
Usual follow-up 150 120 80%
Total 300 255 85%
How It Is Calculated
Completion-rate difference = Incentive-group completion proportion − Usual-follow-up completion proportion
Each proportion is the number completing the specified assessment divided by the number assigned to that retention arrangement.
(135 ÷ 150) − (120 ÷ 150) = 0.90 − 0.80 = 0.10, or 10 percentage points.

In this hypothetical randomized comparison, the observed completion rate is ten percentage points higher in the incentive group.

That difference estimates the effect of offering the incentive on assessment completion within the conditions of the hypothetical evaluation, subject to sampling uncertainty and appropriate implementation.

It does not mean that the incentive increased completion by ten percent relative to the usual-follow-up rate. The relative increase would be 12.5%.

More importantly, the result does not establish that the incentive reduced bias in the study's substantive outcome estimates.

Assessing the Methodological Implications

Examine completion. The team estimates the difference in final-assessment availability and reports uncertainty rather than relying on percentages alone.
Assess sample composition. Researchers compare relevant baseline characteristics among participants with and without observed final outcomes.
Review participant experience. The team examines whether the payment arrangement created concerns about fairness, pressure, or unexpected administrative burden.
Evaluate costs. Researchers consider the resources required for the incentive relative to the additional outcome observations obtained.
Interpret missing data. The substantive analysis still addresses missing outcomes and the assumptions needed for valid inference.

The example illustrates why an incentive can improve data availability without automatically resolving the statistical consequences of missingness.

05 · What Researchers Often Get Wrong

Common Misconceptions About Incentives and Participant Retention

Misconception

Financial Incentives Always Improve Retention

Some incentive arrangements improve response or follow-up completion, but effects vary across settings and designs. Researchers should not assume that every incentive type or amount will be effective.

Misconception

Higher Retention Automatically Means Less Selection Bias

Improved completion can reduce missing information without eliminating systematic differences between observed and unobserved outcomes. The relevant selection mechanisms still require assessment.

Misconception

Any Payment to Research Participants Is Coercive

Compensation is not inherently coercive. Ethical concerns depend on the payment arrangement, risks, participant circumstances, and whether the offer compromises voluntary decision-making.

Misconception

Withholding All Payment Until Completion Is the Best Retention Strategy

Making compensation entirely contingent on completion may create unnecessary pressure and disadvantage participants who withdraw. Prorated arrangements may be more appropriate in many circumstances.

Misconception

Every Participant Must Receive the Same Total Payment

Different participation requirements or legitimate expenses may justify different compensation or reimbursement. However, unequal rewards for equivalent follow-up activities require careful consideration.

Misconception

Researchers Can Introduce New Incentives Without Revising the Protocol

Material changes to approved payment arrangements may require additional ethics or institutional review. Researchers should not modify compensation informally merely because retention is lower than expected.

06 · What This Means for You

Use Incentives to Support Participation, Not to Purchase Continued Consent

Begin by identifying the barriers that participants may face during follow-up. Determine whether reimbursement, compensation, or another retention strategy would address those barriers appropriately.

Then evaluate how the arrangement might influence participation decisions and the composition of the retained sample.

A Simple Decision Framework

If participants incur substantial participation-related expenses
Consider appropriate reimbursement rather than relying exclusively on completion bonuses.
If repeated assessments require meaningful time or effort
Consider proportionate compensation with clear payment conditions and withdrawal arrangements.
If payment could influence the sample's composition
Monitor relevant participant characteristics and assess the implications for the intended estimates.
If study groups have different participation requirements
Distinguish justified expense reimbursement from unequal incentives for equivalent outcome assessments.
If retention remains poor despite incentives
Investigate practical, procedural, and communication barriers before increasing payment.

Incentive arrangements should be explained during consent and implemented consistently with the approved protocol.

Researchers should also consider the administrative implications of payment, including secure handling of any financial information required to process compensation.

The objective is to make participation appropriately supported while preserving the participant's freedom to discontinue.

07 · A Quick Checklist

Before Offering Incentives for Research Follow-Up

Before approving the incentive arrangement, check:
Identify the specific retention barrier or participation demand the incentive is intended to address.
Distinguish expense reimbursement, compensation, and incentives intended to encourage completion.
Review comparable evidence about the effectiveness of the proposed incentive arrangement.
Evaluate whether the amount and payment schedule are proportionate to study demands and risks.
Explain what participants receive for completed activities if they withdraw early.
Assess whether incentives could affect sample composition or differ unjustifiably across study groups.
Avoid linking payment to favorable answers or desired research outcomes.
Document the incentive arrangements in the protocol and obtain applicable ethics approval.
Monitor retention, missing-data patterns, participant concerns, and incentive-related costs.
08 · Frequently Asked Questions

Frequently Asked Questions About Participant Incentives and Retention

Do financial incentives improve participant retention?

Some financial incentive strategies improve follow-up completion, but effectiveness varies by population, study design, payment arrangement, and assessment requirements. Researchers should consult comparable evidence rather than assume a universal effect.

Can incentives introduce selection bias?

Yes. Incentives may influence which individuals enroll or remain available for follow-up. Whether the resulting differences bias a particular estimate depends on their relationship to the research question and outcomes.

Are research participant payments considered coercion?

Payment is not inherently coercive. Researchers should nevertheless assess whether an offer could create undue influence under the circumstances, particularly when participation involves substantial risks or burdens.

Should participants receive compensation if they withdraw?

Compensation for completed activities should follow the approved payment arrangement and applicable requirements. Prorated payment may help avoid making all compensation dependent on full study completion.

Should incentives be identical in intervention and control groups?

Equivalent outcome-assessment activities generally warrant careful consideration of comparable incentives. Different expenses or participation demands may justify differences, but these should be specified and reviewed.

Can nonfinancial incentives improve retention?

They may be useful in some settings, but their effects depend on participant preferences and context. Nonfinancial rewards can also influence participation and should be evaluated rather than assumed neutral.

Does paying participants make their answers less trustworthy?

Not automatically. Payment does not establish dishonest responding. Researchers should design appropriate data-quality procedures and avoid payment conditions that encourage particular answers or careless completion.

Can researchers increase incentives halfway through a study?

Potentially, but material changes may require ethics approval or protocol amendments. Researchers should consider fairness, selection effects, and whether the change addresses the actual cause of missing follow-up.

09 · The Bottom Line

Incentives Can Support Retention Without Guaranteeing Unbiased Data

The Bottom Line

Participant incentives can improve retention in some studies, but their methodological value depends on how they affect participation, missing outcomes, and the composition of the retained sample. Higher completion rates alone do not prove that bias has been reduced.

Use proportionate, transparent, ethically reviewed payment arrangements that recognize participant contributions without making continued consent feel obligatory. Evaluate incentives alongside other retention procedures, and distinguish improvements in data availability from improvements in the validity of the resulting estimates.

10 · Sources and Further Reading

Authoritative Sources on Incentives, Retention, and Research Ethics

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes