03 · What You Need to Know
How to Evaluate Informed Consent Procedures Before Research Begins
What Exactly Is Being Pilot-Tested?
Informed consent is a process through which prospective participants receive relevant information, have an opportunity to consider participation, and make a voluntary decision.
The consent document is one component of that process, but it is not necessarily the process itself.
Pilot testing may examine whether the information is understandable, whether participants recognize their choices, whether questions can be answered adequately, and whether the administrative procedures work.
For example, researchers may test whether prospective participants understand that they can decline participation without academic penalty or whether an electronic consent system records decisions accurately.
The purpose is to evaluate the suitability of the consent process, not merely whether participants can sign or submit a form.
Why Is a Signed Consent Form Not Sufficient Evidence of Understanding?
A signature or electronic acknowledgment documents an action. It does not independently establish that the participant understood the information or made a voluntary decision.
Participants may sign because they trust the researcher, want to complete the process quickly, or assume that signing is expected.
Some may misunderstand important details despite having read the document.
For example, a student may sign a consent form for a classroom intervention without recognizing that participation in the research is separate from participation in ordinary course activities.
Researchers should therefore distinguish consent documentation from evidence of comprehension and voluntariness.
When Is Pilot Testing Especially Appropriate?
Consent pretesting may be particularly valuable when the research involves complex interventions, randomization, unfamiliar data collection technologies, repeated participation, sensitive information, or participants who may face barriers to understanding.
It may also be important when recruitment occurs through relationships involving authority, such as teachers inviting their own students or supervisors inviting employees.
These circumstances do not automatically invalidate consent. They indicate that the process may require additional safeguards and evaluation.
Researchers should consider the seriousness of potential misunderstandings and whether existing evidence supports the adequacy of the proposed procedures.
What Aspects of Consent Can Be Evaluated?
| Consent component |
What to assess |
Potential problem |
| Research purpose |
Whether participants understand that the activity is research and what it seeks to investigate |
Confusion between research and routine services or instruction |
| Participation requirements |
Whether participants understand activities, duration, and follow-up obligations |
Underestimation of workload or commitment |
| Risks and benefits |
Whether relevant risks and potential benefits are understood |
Assumption that personal benefit is guaranteed |
| Voluntariness |
Whether participants recognize their freedom to decline or withdraw |
Perceived academic or institutional pressure |
| Confidentiality |
Whether participants understand how information will be collected, accessed, and protected |
Incorrect assumptions about anonymity or data sharing |
| Randomization |
Whether participants understand allocation procedures where applicable |
Belief that participants or researchers can necessarily choose the assigned condition |
| Consent documentation |
Whether signatures, acknowledgments, or approved alternatives function correctly |
Incomplete or inaccurate records |
| Accessibility |
Whether information can be accessed and understood by the intended population |
Language, disability-related, literacy, or technological barriers |
The relevant components depend on the study. A short anonymous questionnaire and a longitudinal intervention trial may require substantially different consent procedures.
How Can You Assess Participant Comprehension?
One approach is to invite prospective participants or suitable pretest participants to explain important information in their own words.
Researchers may ask what participation involves, whether they can decline, what information will be collected, and what they understand about withdrawal.
This approach is sometimes described as teach-back.
For example, rather than asking, "Do you understand that participation is voluntary?", a researcher might ask, "What would happen if you decided not to participate?"
The second question may reveal misunderstandings that a yes-or-no response would not identify.
However, teach-back should be used respectfully. It is intended to evaluate the clarity of the explanation and support understanding, not to embarrass participants or treat them as examination candidates.
Should You Test the Readability of the Consent Form?
Readability should be considered, particularly when the document contains technical language or lengthy explanations.
Researchers may examine sentence complexity, unfamiliar terminology, organization, and the clarity of key information.
Readability formulas can provide limited information about linguistic complexity, but they do not establish actual comprehension.
A document may achieve a favorable readability score while remaining conceptually confusing.
For example, the phrase "your data will be de-identified" may appear simple but still require explanation of what information will be removed and whether re-identification remains possible.
Testing actual participant understanding is therefore more informative than relying exclusively on a readability score.
Should You Pilot Consent Procedures in the Intended Language?
Yes, when language differences may affect comprehension.
Researchers should ensure that consent information is appropriate for the language proficiency and communication needs of the intended participants.
Translation alone does not guarantee conceptual equivalence.
For example, terms concerning confidentiality, withdrawal, randomization, or data retention may require careful explanation in the language and context of the participants.
Pretesting can identify unfamiliar wording or interpretations that differ from the intended meaning.
Where necessary, researchers should involve qualified translators or individuals with relevant linguistic and cultural expertise.
How Should Consent Be Tested in Online Research?
Online consent procedures may involve electronic information sheets, checkboxes, digital signatures, or other approved acknowledgment methods.
Researchers can test whether participants can access the materials, navigate the consent process, review information before deciding, and submit or decline consent without technical difficulties.
For example, an electronic consent form may display correctly on a desktop computer but become difficult to read on a mobile device.
Another system may unintentionally require participants to accept optional data uses before proceeding.
Such problems should be identified before recruitment begins.
However, technical usability is only one dimension. Participants must also understand the information and retain a meaningful opportunity to decide voluntarily.
What Is the Difference Between Consent Comprehension and Consent Completion?
Consent completion concerns whether the required documentation or acknowledgment is obtained.
Comprehension concerns whether participants understand the relevant information.
Consent completion
Whether the approved consent process has been documented or recorded according to the applicable requirements.
Consent comprehension
Whether participants understand material information needed to make an informed decision about participation.
A process can achieve high completion while leaving important misunderstandings unresolved.
Conversely, a participant may understand the study and voluntarily decline participation. That decision does not indicate failure of the consent process.
Should You Measure a Consent Comprehension Score?
A structured comprehension assessment may be useful when the study involves particularly complex information or when researchers need to evaluate a revised consent approach.
However, a single total score may obscure misunderstandings about essential issues.
For example, a participant may answer most questions correctly but incorrectly believe that withdrawal will affect academic grades.
Researchers should therefore examine comprehension of consequential information rather than relying solely on an average score.
Any scoring instrument should have an appropriate rationale, and thresholds should not be treated as universally established unless supported by relevant evidence or requirements.
How Can You Assess Voluntariness?
Voluntariness concerns whether participation is based on a meaningful choice free from coercion or undue influence.
Researchers may examine whether prospective participants understand that declining is permitted and whether the recruitment setting creates pressure.
For example, students may believe that refusing a teacher's research invitation could affect their grades even when the consent form states otherwise.
Pretesting may reveal these perceptions through confidential questions or interviews.
However, asking participants whether they feel pressured does not guarantee that pressure is absent. The recruitment structure itself should also be examined.
Independent recruitment personnel, separation of research decisions from academic assessment, or other safeguards may be appropriate depending on the study.
Can Consent Piloting Identify Therapeutic or Educational Misconceptions?
Yes. Participants may incorrectly assume that research participation guarantees personal benefit or that the researcher will select procedures according to their individual interests.
In educational research, students may believe that an experimental learning intervention is necessarily superior to ordinary instruction.
Researchers should explain uncertainty about benefits and distinguish the research purpose from routine educational services.
Where randomization is used, participants should understand the relevant allocation procedures.
A pilot can reveal whether these distinctions are understood.
Should Participants Be Allowed to Ask Questions During the Pilot?
Yes. Questions can reveal unclear information and help researchers identify explanations that need improvement.
For example, repeated questions about data retention may indicate that the consent materials do not explain storage arrangements sufficiently.
Researchers should document recurring sources of confusion without collecting unnecessary identifying information.
The objective is to improve the process rather than discourage questions to reduce consent time.
In the definitive study, participants should continue to have appropriate opportunities to seek clarification.
How Should Consent Timing Be Evaluated?
The time required to review consent information may affect the feasibility of recruitment and enrollment.
Researchers can record how long the process takes and identify where participants encounter difficulties.
However, shorter completion time is not automatically better.
A rapid process may reflect clear information, but it may also indicate that participants are skipping material.
The objective should be a practical process that allows adequate consideration rather than the fastest possible consent completion.
Should Consent Be Tested Separately From Recruitment?
Sometimes. Recruitment and consent are connected, but they answer different questions.
Recruitment testing examines whether eligible participants can be reached and enrolled. Consent testing examines whether participation decisions are informed and voluntary.
A recruitment pilot may reveal that many prospective participants decline after reviewing the consent materials. This could reflect a clear understanding of substantial participation requirements rather than a defective consent process.
Researchers should avoid treating lower enrollment as evidence that consent materials need to become more persuasive.
For the related recruitment questions, see Should You Pilot Test Participant Recruitment Procedures?.
How Many People Should Participate in Consent Pretesting?
There is no universal number.
The appropriate scope depends on the complexity of the procedures, the diversity of the intended population, and the purpose of testing.
A small qualitative pretest may identify major comprehension problems. A more structured comparison of consent approaches may require a larger sample and appropriate analytic planning.
Researchers should ensure that the pretest includes relevant communication and accessibility needs where feasible.
Successful testing with a few highly educated or technologically confident participants does not establish that the process will work equally well for all intended participants.
Should You Pilot Consent Before or After Ethics Approval?
The timing depends on the nature of the pretest and the applicable institutional requirements.
Researchers may review draft materials with colleagues or obtain permitted usability feedback during development. However, activities involving prospective research participants, identifiable information, or systematic data collection may require ethics review or an institutional determination before they begin.
Researchers should not assume that describing an activity as a pilot or pretest exempts it from review.
Where the consent procedure changes after approval, an amendment may be required before the revised process is implemented.
The responsible ethics authority should determine the applicable requirements.
What Should You Do When Participants Misunderstand Important Information?
Researchers should identify the source of misunderstanding and revise the explanation or procedure as appropriate.
For example, if participants believe that withdrawal will affect their academic standing, the team may need to revise the consent language and reconsider the recruitment arrangement.
After substantial revisions, additional testing may be warranted.
Researchers should not simply remove comprehension questions that reveal difficulties.
The purpose of the pilot is to identify and address problems before they affect the definitive study.
Can Consent Procedures Change During the Main Study?
Yes, when modifications are justified and comply with applicable ethics requirements.
For example, researchers may discover that participants repeatedly misunderstand a technical term and propose clearer wording.
However, changes affecting risks, data use, participation requirements, or material consent information may require review and approval.
Researchers should document which version of the consent materials was used and whether participants need updated information or renewed consent.
These decisions depend on the nature of the change and the governing requirements.
How Should Consent Pilot Findings Be Reported?
The report should describe what was tested, who participated, which comprehension or usability problems were identified, and what changes followed.
Where quantitative indicators are used, researchers should report relevant numerators, denominators, and uncertainty.
Qualitative findings may describe recurring misunderstandings or participant concerns.
Researchers should distinguish observed comprehension from assumptions based on form completion.
They should also avoid claiming that the consent process is universally effective merely because the pilot identified no major problems.
Watch Out
Do not treat a high consent rate as proof of ethical adequacy. A participant who understands the study and declines has exercised an informed choice. The objective is valid, voluntary decision-making, not maximizing the proportion who agree to participate.
