Designing a Study You Can Defend
A suitable research instrument may exist only in a language your participants do not understand well. Learn how to evaluate existing translations, plan responsible translation and cultural adaptation, and determine what evidence is needed before using the instrument.
Read Guide →
Designing a Study You Can Defend
A longer research instrument may assess more dimensions, but additional items do not necessarily improve measurement for every study. Learn when a shorter measure can provide more appropriate, efficient, and defensible evidence.
Read Guide →
Designing a Study You Can Defend
Objective measures are not automatically more valid than self-report instruments. Learn when subjective reports provide more relevant evidence, when behavioral or device-based measures are preferable, and how to justify the choice.
Read Guide →
Designing a Study You Can Defend
Using multiple measurement methods can strengthen evidence about a construct, but additional measures do not automatically establish validity. Learn when multimethod measurement is worthwhile, how to interpret agreement and disagreement, and how to avoid combining incompatible indicators.
Read Guide →
Designing a Study You Can Defend
Measurement procedures may function differently across intervention groups, demographic populations, or study sites. Learn how differential measurement error can create misleading group differences, conceal genuine effects, and undermine the interpretation of comparative research.
Read Guide →
Designing a Study You Can Defend
Respondents may remember earlier answers when completing repeated surveys, potentially influencing their later responses. Learn how response memory can create artificial consistency or change, how it differs from genuine longitudinal change, and how to design repeated measurements more carefully.
Read Guide →
Designing a Study You Can Defend
Interviewers can influence research measurements even when they follow the same questionnaire. Learn how questioning, probing, expectations, interpersonal interactions, and recording practices can introduce systematic error, and how to design more consistent data collection procedures.
Read Guide →
Designing a Study You Can Defend
Different study sites may introduce measurement differences even when they use the same instrument. Learn which procedures should be standardized, how to accommodate legitimate site differences, and how to establish defensible cross-site comparability.
Read Guide →
Designing a Study You Can Defend
Measurement quality control should begin before the first participant is assessed. Learn how to identify measurement risks, establish acceptance criteria, train personnel, monitor data quality, and plan corrective actions that protect the credibility of research findings.
Read Guide →
Designing a Study You Can Defend
Instrument development and substantive hypothesis testing have different methodological purposes. Learn when to conduct development as a separate study, when a multiphase project is defensible, and how to avoid using insufficiently evaluated scores in the main analysis.
Read Guide →
Designing a Study You Can Defend
A newly developed instrument may be promising but insufficiently evaluated for the conclusions a study intends to draw. Learn how to identify critical measurement risks, distinguish manageable uncertainty from unacceptable weaknesses, and decide whether to proceed, revise, or postpone the main study.
Read Guide →
Designing a Study You Can Defend
An established instrument may be appropriate for a new population, but previous validity evidence does not automatically transfer. Learn how to evaluate construct relevance, item comprehension, scoring, and measurement comparability before adapting an instrument for different respondents.
Read Guide →
Designing a Study You Can Defend
Direct translation may preserve the literal wording of a questionnaire while changing what respondents understand. Learn why linguistic accuracy does not guarantee measurement equivalence, when literal translation is problematic, and how to evaluate translated items before using them in research.
Read Guide →
Designing a Study You Can Defend
Translated questionnaires do not automatically produce comparable scores across language groups. Learn when measurement equivalence testing is necessary, how configural, metric, and scalar invariance differ, and what to do when items function differently across languages.
Read Guide →
Designing a Study You Can Defend
Research can be distorted at many points between defining a question and reporting a result. Bias and confounding are not interchangeable problems, and preventing them often requires design decisions long before statistical analysis begins.
Read Guide →
Designing a Study You Can Defend
Rigor in qualitative research concerns whether the study provides a methodologically coherent, transparent, and well-supported interpretation of the phenomenon. Credibility, dependability, confirmability, and transferability provide one influential framework for thinking about that trustworthiness.
Read Guide →
Designing a Study You Can Defend
Rigorous mixed-methods research requires more than conducting a quantitative study and a qualitative study in the same project. Each component must be methodologically sound, and their integration must be justified, coherent, transparent, and capable of producing insights that matter to the research question.
Read Guide →
Designing a Study You Can Defend
Not every research limitation is a design flaw. Some limitations are defensible consequences of answering a particular question under ethical, practical, or methodological constraints, while others undermine the very inference the study claims to make.
Read Guide →
Designing a Study You Can Defend
A difference between research groups or a change over time does not necessarily establish an intervention's effect. Learn how to identify threats to internal validity, assess competing explanations, and protect the credibility of your study's main comparison.
Read Guide →
Designing a Study You Can Defend
When research groups differ before an intervention begins, their subsequent outcomes may not provide a fair comparison. Understand how selection differences threaten internal validity, when they create confounding, and which design strategies can make causal conclusions more credible.
Read Guide →
Designing a Study You Can Defend
An improvement after an intervention does not necessarily mean the intervention caused it. Understand how external events create history effects, when they threaten before-and-after comparisons, and which research designs can help distinguish intervention effects from concurrent changes.
Read Guide →
Designing a Study You Can Defend
Participants may improve, deteriorate, or adapt naturally during a study, even without an intervention. Learn when maturation threatens causal conclusions, how it differs from other time-related threats, and which design strategies help researchers distinguish natural change from intervention effects.
Read Guide →
Designing a Study You Can Defend
Participants selected because of unusually high or low scores may appear to improve or deteriorate even without an effective intervention. Learn why regression to the mean occurs, how it can distort causal conclusions, and how researchers can design more credible comparisons.
Read Guide →
Designing a Study You Can Defend
A difference between research groups or measurement occasions may reflect changes in how outcomes were assessed rather than genuine intervention effects. Understand instrumentation threats, recognize when measurements are not comparable, and learn how to protect the validity of your research conclusions.
Read Guide →
Designing a Study You Can Defend
When participants in one research group receive elements of another group's intervention, the intended comparison may change. Learn how contamination occurs, why it can distort treatment effects, and how to prevent, measure, and report intervention spillover.
Read Guide →
