Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Can Baseline Measurement Itself Change Participant Behavior?

Baseline measurement is not always a neutral observation. Asking participants about their knowledge, attitudes, or behavior may influence what they subsequently do. Learn when measurement reactivity matters and how researchers can design studies to identify or minimize its effects.

371
Can Baseline Measurement Change Behavior? Guide 371 of 1272
01 · The Question

Could Measuring Participants Before an Intervention Change What They Do?

You are preparing an intervention study and plan to assess participants before the intervention begins. Perhaps you will ask students about their study habits, test their knowledge, or measure their motivation. The assessment seems necessary because you want to establish their starting conditions.

But what if completing the assessment changes those conditions?

A student who answers questions about procrastination may become more conscious of missed deadlines. Someone who completes a knowledge test may recognize gaps in understanding and begin studying independently. Participants might change their behavior before receiving the intervention, simply because the research has drawn their attention to it.

This raises a methodological question: can baseline measurement influence the very outcome researchers intend to study?

02 · The Short Answer

Yes, Baseline Assessment Can Influence Subsequent Behavior

In Brief

Baseline measurement can change participants' knowledge, awareness, attitudes, or behavior, particularly when assessments draw attention to the behavior being studied, provide opportunities for practice, or influence expectations. This phenomenon is commonly discussed as measurement reactivity, with related concepts including the question-behavior effect and pretest sensitization.

These effects are not inevitable, and their magnitude varies across contexts. Whether they threaten validity depends on the measurement procedure, study design, causal question, and whether measurement affects intervention and comparison groups differently.

03 · What You Need to Know

How Baseline Assessment Can Influence Research Outcomes

Measurement Is Not Always a Passive Observation

Researchers often treat baseline measurement as a procedure that records an existing condition without changing it. That assumption is reasonable for some measurements but less secure for assessments involving knowledge, beliefs, intentions, and behavior.

Answering questions can require participants to reflect on experiences they might otherwise ignore. Completing a performance test can provide practice. Being observed may influence how individuals behave, particularly when they recognize which behavior is being evaluated.

These possibilities matter because baseline measurement is part of the research procedure. If it changes participants' subsequent responses, the observed outcome may reflect both the intervention and the measurement process.

This does not mean that every pretest is problematic. Rather, researchers should consider whether the assessment could plausibly influence the outcome and whether the study design can accommodate that influence.

What Is Measurement Reactivity?

Measurement reactivity refers to changes in participants' responses or behavior associated with the act of measurement or observation.

For example, asking participants to record their daily screen time may make them more aware of device use. That awareness could lead some participants to reduce their screen time, even without receiving a separate behavior-change intervention.

Similarly, asking students to report how frequently they revise course materials may prompt reflection on their study routines.

Measurement reactivity can arise through several mechanisms, but researchers should not assume that any observed behavioral change was caused by the assessment. Natural change, concurrent experiences, and other study procedures may offer alternative explanations.

How Is the Question-Behavior Effect Different?

The question-behavior effect describes situations in which asking people questions about a behavior influences their subsequent performance of that behavior.

Questions about intentions, expectations, or past behavior may make particular actions more cognitively accessible or encourage participants to evaluate whether their behavior is consistent with their stated intentions.

For example, asking students whether they intend to complete weekly practice exercises could potentially influence their subsequent engagement with those exercises.

Research syntheses have reported evidence of question-behavior effects, although effect estimates and their generalizability vary with study characteristics, measurement procedures, and analytical decisions.

Researchers should therefore treat the effect as a plausible design consideration rather than assume that asking about a behavior will reliably increase or decrease it.

What Is Pretest Sensitization?

Pretest sensitization occurs when exposure to a pretest changes how participants respond to a subsequent intervention or assessment.

Suppose students complete a pretest containing questions about specific statistical concepts. The questions may reveal which topics deserve attention, encouraging students to study those concepts before or during the intervention.

The pretest might also make students more receptive to an instructional program that addresses the tested material.

In this situation, baseline assessment does more than influence behavior independently. It may modify the effect of the intervention itself.

This distinction is important because an intervention evaluated among pretested participants may not produce the same effect among individuals who receive the intervention without that preliminary assessment.

Distinguish Measurement Reactivity, Testing Effects, and Pretest Sensitization

Concept Central concern Illustrative example
Measurement reactivity Measurement changes the participant's behavior or response. Recording study time encourages more consistent studying.
Question-behavior effect Answering questions about a behavior influences subsequent behavior. Reporting intended attendance influences later attendance.
Testing or practice effect Previous assessment exposure affects performance on a later assessment. Students perform better partly because they recognize the test format.
Pretest sensitization A pretest changes responsiveness to a subsequent intervention. Pretesting makes students more attentive to instructional content.

These concepts overlap, and the terminology is not always used identically across disciplines. Their common implication is that assessment procedures may influence what researchers subsequently observe.

Can Baseline Measurement Improve Outcomes Without the Intervention?

Potentially. An assessment may encourage self-monitoring, reflection, information seeking, or behavioral adjustment.

In educational research, completing a diagnostic test might motivate students to review material. In health research, questions about physical activity may encourage participants to reconsider their activity patterns.

However, the direction of measurement effects is not necessarily beneficial. Assessments may increase anxiety, produce fatigue, discourage participants, or alter behavior in ways that depend on the context.

Researchers should avoid describing all assessment-induced changes as improvements. The relevant issue is whether the measurement changes the outcome or the response to intervention.

Does Giving Both Groups the Same Baseline Assessment Solve the Problem?

Not completely.

When intervention and control groups receive equivalent baseline assessments, measurement-related changes that affect both groups similarly may not bias their randomized comparison. This is one reason consistent assessment procedures are important.

Nevertheless, equal exposure to a pretest does not guarantee that its effects are identical across groups.

The intervention may reinforce information introduced by the pretest, while the comparison condition does not. Alternatively, the pretest might encourage independent behavior change among control participants, reducing the observed difference between groups.

Even if the randomized comparison remains internally valid, the estimated effect may describe the intervention under conditions that include pretesting. It may not represent the effect of delivering the intervention without that assessment.

This distinction concerns both causal interpretation and applicability to settings outside the study.

How Can Researchers Determine Whether Pretesting Changes Intervention Effects?

One established approach is the Solomon four-group design, which combines intervention assignment with the presence or absence of pretesting.

In its conventional form, participants are randomly assigned to four conditions:

Group Pretest Intervention Posttest
A Yes Yes Yes
B Yes No Yes
C No Yes Yes
D No No Yes

This design permits researchers to examine intervention effects with and without pretesting and to investigate whether pretesting modifies the intervention effect.

For example, the intervention-control comparison among pretested participants can be contrasted with the corresponding comparison among participants who were not pretested.

The design has limitations. It requires additional participants or allocation groups, may increase logistical complexity, and can provide imprecise estimates of interactions unless adequately powered.

Furthermore, all groups still undergo a posttest, so the design does not eliminate every possible form of assessment reactivity.

A Solomon design is therefore useful when pretest sensitization is a substantive concern, not an obligatory feature of intervention research.

Should Researchers Eliminate Baseline Measurement to Avoid Reactivity?

Not automatically. Removing baseline assessment may reduce measurement-induced effects, but it can also eliminate valuable information.

Baseline measurements may establish eligibility, characterize participants, support adjustment for prognostic characteristics, and improve statistical precision.

In observational studies, appropriately timed baseline information may be necessary to address confounding.

Researchers should therefore evaluate the benefits of measuring the primary outcome at baseline against the potential for reactivity.

For some randomized studies, a posttest-only design may be suitable. For others, the information gained from pretesting may justify retaining it despite a plausible measurement effect.

How Can Baseline Measurement Reactivity Be Reduced?

Several design choices may help, depending on the mechanism of concern.

Researchers can avoid unnecessary questions that explicitly encourage behavioral intentions or self-evaluation when those questions are not required by the research objectives.

They may use less intrusive measurement procedures, existing records, or unobtrusive indicators when these provide valid information and satisfy ethical and privacy requirements.

For repeated performance assessments, equivalent alternative test forms may help reduce item familiarity, although their comparability must be established.

Measurement procedures should be standardized across relevant groups, and researchers should avoid giving feedback that could function as an unintended intervention unless feedback is part of the protocol.

Researchers should also consider the timing of baseline assessments. A short interval between pretesting and intervention may be useful for representing current conditions, but it could also intensify immediate priming or fatigue.

None of these strategies guarantees the absence of reactivity. Their appropriateness depends on the assessment and the causal question.

Can Measurement Reactivity Affect Follow-Up Assessments Too?

Yes. Repeated follow-up assessments may encourage self-monitoring, provide practice, or repeatedly remind participants of the study's target behavior.

For example, participants asked to report weekly exercise may become more attentive to physical activity than participants assessed only at the end of the study.

Thus, the number of follow-up measurements can influence not only the amount of information collected but also the experience of participation.

Researchers should distinguish the scientific value of frequent assessment from the possibility that assessment frequency changes the phenomenon being observed.

04 · A Practical Example

When a Study-Habits Questionnaire Becomes Part of the Intervention

Hypothetical Example

Evaluating a Digital Study-Planning Tool

A research team plans a randomized trial of a digital study-planning tool. Students in the intervention group will receive structured weekly planning prompts, while students in the control group will continue their usual study practices.

The primary outcome is the proportion of scheduled study sessions completed during six weeks. The researchers initially propose a detailed baseline questionnaire asking students to identify their procrastination habits, estimate wasted study time, and specify intended improvements.

Identify the potential measurement effect. The questionnaire asks students to evaluate their current behavior and formulate improvement intentions. These activities resemble components of the planned intervention.
Clarify the estimand. The researchers determine whether they want to estimate the additional effect of the digital tool after a reflective baseline assessment or its effect under ordinary implementation without such an assessment.
Review alternative baseline information. They consider whether existing learning-management-system records can characterize previous study activity without requiring participants to complete an extensive reflective questionnaire.
Choose an appropriate design. If pretest sensitization is central to the research question, the team considers randomizing participants to pretested and non-pretested conditions. Otherwise, it may use a shorter, standardized baseline assessment.
Interpret the resulting effect carefully. The researchers report whether the intervention effect was estimated in the presence of baseline assessment and acknowledge the implications for implementation without pretesting.

Suppose the control group increases its study planning after completing the baseline questionnaire. That change alone would not prove measurement reactivity, because other explanations remain possible.

However, if a suitably designed randomized comparison showed different outcomes between pretested and non-pretested control participants, it would provide stronger evidence that the pretest influenced subsequent behavior.

The important lesson is that baseline assessment should be treated as a potentially active research procedure when its content overlaps with the behavior an intervention seeks to change.

05 · What Researchers Often Get Wrong

Misconceptions About Baseline Measurement Effects

Misconception

Baseline Measurement Cannot Affect the Outcome Because It Occurs Before Intervention

Pre-intervention assessments can influence subsequent knowledge, expectations, and behavior. Their timing does not make them causally inert.

Misconception

Using the Same Pretest in Both Groups Eliminates Every Measurement Effect

Equivalent pretesting may support internal comparability, but the pretest can interact with intervention assignment or change the conditions under which the intervention effect is estimated.

Misconception

Any Improvement After Pretesting Demonstrates a Question-Behavior Effect

Observed improvement could reflect natural development, concurrent experiences, regression to the mean, or other influences. A suitable comparison is needed to attribute change to measurement.

Misconception

Removing Every Baseline Assessment Always Improves Validity

Eliminating pretests may reduce some forms of reactivity but can sacrifice important information about initial outcomes, eligibility, and prognostic characteristics.

Misconception

Measurement Reactivity Always Produces Positive Behavior Change

Assessment may encourage desirable behavior, but it can also create anxiety, fatigue, discouragement, or other changes. The direction and magnitude of effects depend on the context.

Misconception

A Solomon Four-Group Design Is Necessary Whenever a Pretest Is Used

The design can help investigate pretest effects and interactions, but it requires additional resources. Its use should be justified by the importance of the question and the feasibility of obtaining informative comparisons.

06 · What This Means for You

Assess Whether Your Baseline Procedure Could Function as an Intervention

Review the content and administration of each proposed baseline measure. Consider what participants may learn, notice, practice, or infer from completing it.

The concern is especially relevant when the assessment addresses the same knowledge, intentions, or behaviors targeted by the intervention.

A simple decision framework

If the baseline measure is unlikely to influence subsequent behavior
Retain it when scientifically useful, while maintaining consistent administration and documenting its timing.
If the assessment encourages reflection or behavioral intentions
Consider whether less reactive alternatives can provide the required information without changing the construct being measured.
If pretesting may interact with the intervention
Consider a design that permits estimation of pretest effects or explicitly define the intervention effect as conditional on pretesting.
If baseline outcome adjustment offers substantial analytical value
Weigh the expected precision benefit against potential reactivity rather than automatically eliminating the measurement.
If repeated assessments may encourage self-monitoring
Evaluate whether the follow-up schedule is scientifically necessary and whether assessment frequency should be treated as part of the study conditions.

Where measurement reactivity is plausible, describe the assessment procedures sufficiently for readers to understand the conditions under which the intervention was evaluated.

Acknowledge uncertainty rather than claiming that a measurement effect occurred without evidence capable of distinguishing it from alternative explanations.

07 · A Quick Checklist

Before Administering a Potentially Reactive Baseline Assessment

Before finalizing baseline measurement, check:
Identify whether the assessment asks participants to reflect on, practice, or plan changes to the target behavior.
Determine whether the pretest could reveal intervention content or assessment expectations.
Assess whether baseline measurement is essential for eligibility, interpretation, or the planned statistical analysis.
Consider validated alternative forms, existing records, or less intrusive measurement procedures where appropriate.
Standardize baseline procedures across relevant study groups unless measurement itself is experimentally varied.
Evaluate whether pretesting could interact with the intervention rather than affect all groups equally.
Determine whether a posttest-only or Solomon four-group design is scientifically justified and feasible.
Consider possible fatigue, anxiety, practice effects, and other unintended consequences of assessment.
Document the measurement procedure and any plausible implications for interpreting the intervention effect.
08 · Frequently Asked Questions

Frequently Asked Questions About Measurement Reactivity

Can a questionnaire change participant behavior?

Yes. Questions about intentions, habits, or behavior may influence subsequent actions in some circumstances. However, such effects vary, and a questionnaire should not automatically be assumed to produce behavioral change.

Is measurement reactivity the same as the Hawthorne effect?

Not exactly. Measurement reactivity concerns changes associated with measurement or observation. The term Hawthorne effect has been used more broadly for changes attributed to awareness of being studied, although its definition and empirical interpretation remain contested.

Can a pretest improve posttest scores without an intervention?

Yes. Practice, familiarity with test formats, or learning prompted by pretesting may affect later performance. The extent depends on the assessment and circumstances.

Does pretest sensitization invalidate a randomized trial?

Not necessarily. Randomization may still support a valid comparison under the study's pretesting conditions. However, the estimated intervention effect may not generalize directly to settings where participants are not pretested.

What is a Solomon four-group design?

It is an experimental design that combines intervention assignment with assignment to pretesting or no pretesting. It allows researchers to investigate whether pretesting influences outcomes or modifies intervention effects.

Should researchers avoid asking about behavioral intentions at baseline?

Not universally. Intention measures may be necessary for the research question. Researchers should consider their potential reactivity and whether the information gained justifies the assessment.

Can repeated follow-up questionnaires also influence behavior?

Yes. Repeated assessment can promote self-monitoring or reflection and may affect subsequent responses. Assessment frequency should therefore be considered during longitudinal study design.

09 · The Bottom Line

Baseline Measurement Can Become Part of the Causal Process

The Bottom Line

Baseline measurement can influence participants' subsequent knowledge, attitudes, performance, or behavior, so researchers should consider whether assessment procedures may affect the outcome or modify the intervention effect.

The appropriate response is not necessarily to eliminate pretesting. It is to balance the information gained against possible reactivity, use suitable comparison designs when the effect matters, and interpret results in light of the measurement conditions actually used.

10 · Sources and Further Reading

Research on Measurement Reactivity and Pretest Effects

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes