Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Part 04 · Design

Designing a Study You Can Defend

Design a credible research study by choosing appropriate methods, sampling strategies, measures, and procedures that fit your research question and produce evidence capable of supporting defensible conclusions.

Why This Stage Matters

Your question should determine how you study it.

An interesting research question becomes meaningful evidence only when the study is designed to answer it appropriately. Choices about approach, participants, measurements, procedures, and comparisons determine what researchers will be able to observe and what conclusions the resulting evidence can reasonably support.

Research design therefore involves a series of connected methodological decisions. Researchers must consider quantitative, qualitative, or mixed approaches, select suitable study designs and sampling strategies, determine appropriate sample sizes, and address validity, reliability, bias, feasibility, and other threats to credible findings.

More sophisticated methods do not automatically produce stronger research. A defensible design is one in which each methodological choice has a clear reason, important limitations have been anticipated, and the evidence being collected is genuinely capable of addressing the question the study set out to investigate.

Part 04 · 138 Sections · 1349 Guides

From research question to study design

Work through the methodological decisions that determine how your research will produce credible evidence.

01
how to choose a research design How to Choose the Right Research Design for Your Research Question
→
02
what is research design What Is Research Design, and What Is It Actually Supposed to Accomplish?
→
03
quantitative vs qualitative vs mixed methods Quantitative vs. Qualitative vs. Mixed Methods: Which Approach Should You Use?
→
04
exploratory descriptive explanatory evaluative research What Makes a Study Exploratory, Descriptive, Explanatory, or Evaluative?
→
05
exploratory descriptive explanatory research designs Are Exploratory, Descriptive, Explanatory, and Evaluative Studies Actually Research Designs?
→
06
descriptive and explanatory research Can a Study Be Both Descriptive and Explanatory?
→
07
multiple research designs in one study Can One Study Have More Than One Research Design?
→
08
how to name a research design How Specific Should You Be When Naming Your Research Design?
→
09
do you have to name your research design Do You Have to Name Your Research Design at All?
→
10
appropriate research design What Makes a Research Design Appropriate for a Research Question?
→
11
different research designs same research question Can Two Different Research Designs Answer the Same Research Question?
→
12
best research design for a research question Is There Always One “Best” Research Design for a Research Question?
→
13
ideal vs feasible research design Should You Choose the Ideal Design or the Best Design You Can Realistically Conduct?
→
14
research design before evidence requirements Should You Choose the Design Before Deciding Exactly What Evidence You Need?
→
15
strongest research design Should the Strongest Possible Design Always Be Chosen?
→
16
simple vs sophisticated research design Can a Simpler Design Be More Defensible Than a More Sophisticated Design?
→
17
research design purpose mismatch Can a Design Be Technically Correct but Poorly Matched to the Real Research Purpose?
→
18
common research design wrong question Can a Design Be Common in Your Field but Still Wrong for Your Question?
→
19
methodological compromise research question When Does Methodological Compromise Become a Different Research Question?
→
20
research design essential capabilities What Must a Research Design Be Capable of Doing Before You Should Consider It Further?
→

21
evidence for a research question What Kind of Evidence Does Your Research Question Actually Require?
→
22
evidence needed to answer a research question What Kind of Evidence Would Actually Answer Your Research Question?
→
23
types of evidence in research Does Your Question Require Description, Comparison, Association, Prediction, Explanation, or Causal Evidence?
→
24
numerical vs experiential evidence Does Your Question Require Numerical Evidence, Experiential Evidence, or Both?
→
25
prevalence and frequency in research Does Your Question Require Evidence About Prevalence or Frequency?
→
26
evidence of change over time in research Does Your Question Require Evidence About Change Over Time?
→
27
evidence about individual experiences in research Does Your Question Require Evidence About Individual Experiences?
→
28
mechanism evidence in research Does Your Question Require Evidence About Mechanisms?
→
29
contextual evidence in research Does Your Question Require Evidence About Context?
→
30
implementation evidence in research Does Your Question Require Evidence About Implementation?
→
31
effectiveness evidence in research Does Your Question Require Evidence About Effectiveness?
→
32
harms and benefits in research Does Your Question Require Evidence About Harms as Well as Benefits?
→
33
why vs whether research questions Does Your Question Require Evidence About Why Something Happened Rather Than Merely Whether It Happened?
→
34
insufficient research evidence What Evidence Would Be Insufficient to Answer the Question Convincingly?
→
35
research design from intended claims How Do You Work Backward From the Claim You Want to Make to the Design Capable of Supporting It?
→

36
when to use quantitative research When Is a Quantitative Approach the Best Fit for the Question?
→
37
when to use qualitative research When Is a Qualitative Approach the Best Fit for the Question?
→
38
when to use mixed-methods research When Is a Mixed-Methods Approach Actually Necessary?
→
39
can quantitative research answer why questions Can a Quantitative Study Answer a “Why” Question?
→
40
can qualitative research answer how much questions Can a Qualitative Study Answer a “How Much” Question?
→
41
qualitative research explain quantitative findings Can Qualitative Research Explain a Quantitative Finding?
→
42
quantitative testing of qualitative findings Can Quantitative Research Test a Pattern First Identified Qualitatively?
→
43
mixed methods data availability Should You Use Mixed Methods Simply Because Both Types of Data Are Available?
→
44
mixed methods reviewer expectations Should You Use Mixed Methods Because Reviewers Expect a More Comprehensive Study?
→
45
underdeveloped mixed-methods components Can Mixed Methods Make a Study Weaker by Adding an Underdeveloped Second Component?
→
46
single method vs mixed methods research When Is One Well-Executed Method Better Than Two Poorly Integrated Methods?
→
47
researcher skills methodological choice Should Researcher Skill Influence Whether You Choose Quantitative, Qualitative, or Mixed Methods?
→
48
sample size methodological choice Should Available Sample Size Influence the Methodological Approach?
→
49
time constraints methodological choice Should Available Time Influence the Methodological Approach?
→

50
experimental vs quasi-experimental vs observational studies Experimental, Quasi-Experimental, and Observational Studies: What’s the Difference?
→
51
cross-sectional vs longitudinal research Cross-Sectional vs. Longitudinal Research: Which Design Fits Your Study?
→
52
prospective vs retrospective research Prospective vs. Retrospective Research: What’s the Difference and Why Does It Matter?
→
53
cohort vs case-control studies Cohort vs. Case-Control Studies: What’s the Difference and When Should You Use Each?
→
54
phenomenology vs ethnography vs grounded theory When Should You Use Phenomenology, Ethnography, Grounded Theory, or Narrative Research?
→
55
timing of data collection in research How Does the Timing of Data Collection Affect What a Study Can Establish?
→
56
choosing experimental vs observational design How Do You Choose Between an Experimental and Observational Design?
→
57
choosing prospective vs retrospective design How Do You Choose Between a Prospective and Retrospective Design?
→
58
choosing cross-sectional vs longitudinal data How Do You Choose Between Cross-Sectional and Longitudinal Data?
→
59
prospective follow-up vs retrospective reconstruction How Do You Choose Between Following Participants Forward and Reconstructing What Happened in the Past?
→
60
cross-sectional and longitudinal research question Can One Research Question Be Answered by Both Cross-Sectional and Longitudinal Designs?
→
61
multisite research generalizability When Does Adding More Sites Improve Generalizability but Make the Study Harder to Control?
→

114
cross-sectional or longitudinal research design Can the Same Research Question Be Studied Using Cross-Sectional or Longitudinal Designs?
→
115
time points in research design When Does Adding Another Time Point Fundamentally Change the Study Design?
→
116
when research requires longitudinal data When Does a Research Question Need Longitudinal Data?
→
117
how many time points longitudinal study How Many Time Points Does a Longitudinal Study Need?
→
118
two-time-point longitudinal study Is Two Time Points Really Longitudinal Enough for the Question?
→
119
choosing longitudinal measurement intervals How Do You Choose the Spacing Between Measurements?
→
120
measurement frequency and rapid change What Happens When the Process Changes Faster Than Your Measurement Schedule?
→
121
slow change in longitudinal studies What Happens When the Process Changes More Slowly Than Your Follow-Up Period?
→
122
repeated measurement of variables in longitudinal studies Should Every Variable Be Measured at Every Time Point?
→
123
participant attrition in longitudinal studies How Do You Design for Participant Attrition?
→
124
age period cohort effects How Do You Distinguish Age, Period, and Cohort Effects?
→
125
longitudinal data temporal order causation Can Longitudinal Data Establish Temporal Order Without Establishing Causation?
→
126
when longitudinal design is unnecessary When Is a Longitudinal Design Not Worth the Extra Complexity?
→
127
existing longitudinal data vs new cohort Can Existing Longitudinal Data Answer the Question Better Than Collecting a New Cohort?
→

138
when to use a randomized controlled trial When Is a Randomized Controlled Trial the Right Research Design?
→
139
when is an RCT unnecessary When Is a Randomized Controlled Trial Unnecessary?
→
140
when randomized controlled trials are inappropriate When Is a Randomized Controlled Trial Infeasible or Inappropriate?
→
141
what to randomize in a controlled trial What Exactly Should Be Randomized in a Randomized Controlled Trial?
→
142
unit of randomization Should You Randomize Individuals, Groups, Sites, or Time Periods in an RCT?
→
143
number of arms in a randomized controlled trial How Many Study Arms Should a Randomized Controlled Trial Have?
→
144
two-arm vs multi-arm trials Should You Use a Two-Arm or Multi-Arm Randomized Controlled Trial?
→
145
choosing control groups in randomized trials Should You Use a Placebo, Usual-Care, Active, or No-Treatment Control Group in an RCT?
→
146
multiple primary questions in randomized trials Can a Randomized Controlled Trial Answer More Than One Primary Research Question?
→
147
pilot phase randomized controlled trial When Does a Randomized Controlled Trial Need a Pilot Phase?
→
148
run-in period clinical trial When Does a Clinical Trial Need a Run-In Period?
→
149
washout period randomized trial When Does a Clinical Trial Need a Washout Period?
→
150
pragmatic randomized controlled trial Can a Randomized Controlled Trial Also Be Pragmatic?
→
151
internal validity and real-world relevance in RCTs How Do You Balance Internal Validity and Real-World Relevance in an RCT?
→

219
when to use a quasi-experimental design When Should You Use a Quasi-Experimental Design?
→
220
quasi-experimental vs observational study What Makes a Study Quasi-Experimental Rather Than Observational?
→
221
quasi-experimental causal inference Can a Quasi-Experiment Support Causal Inference?
→
222
credible comparison group in quasi-experimental research What Makes a Comparison Group Credible in a Quasi-Experiment?
→
223
when to use difference-in-differences When Is Difference-in-Differences an Appropriate Design Strategy?
→
224
parallel trends assumption difference-in-differences What Is the Parallel Trends Assumption in Difference-in-Differences?
→
225
when to use regression discontinuity When Is Regression Discontinuity Appropriate?
→
226
assignment cutoff regression discontinuity What Makes an Assignment Cutoff Suitable for Regression Discontinuity?
→
227
instrumental variable design When Is an Instrumental-Variable Design Appropriate for Causal Inference?
→
228
interrupted time-series design When Is an Interrupted Time-Series Design Appropriate?
→
229
interrupted time series number of observations How Many Pre- and Post-Intervention Observations Does an Interrupted Time Series Need?
→
230
controlled interrupted time series When Is a Controlled Interrupted Time-Series Design Stronger Than an Uncontrolled Design?
→
231
choosing a quasi-experimental design How Do You Choose Among Quasi-Experimental Designs?
→
232
weak quasi-experiment vs strong observational study When Is a Weak Quasi-Experiment Less Informative Than a Strong Observational Study?
→

304
mixed methods research When Is Mixed Methods Actually Mixed Methods, and When Are You Just Collecting Two Types of Data?
→
305
what makes a study mixed methods Why Doesn’t Using Both Numbers and Words Automatically Make a Study Mixed Methods?
→
306
research questions requiring mixed methods What Research Questions Actually Require Mixed Methods?
→
307
integration problem in mixed methods research What Integration Problem Is a Mixed-Methods Study Trying to Solve?
→
308
quantitative and qualitative priority in mixed methods Should the Quantitative or Qualitative Component Have Priority in a Mixed-Methods Study?
→
309
equal weight in mixed methods research Should Quantitative and Qualitative Components Have Equal Weight in Mixed-Methods Research?
→
310
sequential vs concurrent mixed methods Should Quantitative and Qualitative Components Occur Sequentially or Concurrently?
→
311
qualitative data to explain quantitative results Should Qualitative Data Be Used to Explain Quantitative Results in Mixed-Methods Research?
→
312
using qualitative findings to develop quantitative instruments Should Qualitative Findings Help Develop a Quantitative Instrument or Intervention?
→
313
using quantitative results to select interview participants Should Quantitative Results Determine Which Participants to Interview Next?
→
314
embedding components in mixed methods research Can One Component Be Embedded Within Another Research Design in Mixed-Methods Research?
→
315
where to integrate mixed methods data How Do You Decide Where Integration Will Occur in a Mixed-Methods Study?
→
316
conflicting quantitative and qualitative findings What Happens When Quantitative and Qualitative Findings Conflict in Mixed-Methods Research?
→
317
avoid separate studies in mixed methods research How Do You Avoid Conducting Two Separate Studies and Calling Them Mixed Methods?
→

318
sequential vs concurrent mixed methods Sequential vs. Concurrent Mixed Methods: Which Should Come First and Why?
→
319
quantitative first sequential mixed methods When Should Quantitative Data Come First in Sequential Mixed-Methods Research?
→
320
qualitative first sequential mixed methods When Should Qualitative Data Come First in Sequential Mixed-Methods Research?
→
321
explanatory sequential mixed methods design What Is an Explanatory Sequential Mixed-Methods Design?
→
322
exploratory sequential mixed methods design What Is an Exploratory Sequential Mixed-Methods Design?
→
323
selecting first-phase findings in sequential mixed methods How Do You Decide Which First-Phase Findings Should Guide the Second Phase of a Sequential Mixed-Methods Study?
→
324
same participants in sequential mixed methods Should the Same Participants Be Used in Both Phases of Sequential Mixed-Methods Research?
→
325
connecting samples in sequential mixed methods How Do You Connect Samples Across Phases in Sequential Mixed-Methods Research?
→
326
time between sequential mixed methods phases How Much Time Should Be Allowed Between Phases in Sequential Mixed-Methods Research?
→
327
unclear first-phase findings in sequential mixed methods What Happens When the First Phase of a Sequential Mixed-Methods Study Provides No Clear Direction for the Second Phase?
→
328
sequential mixed methods short thesis timeline Can Sequential Mixed-Methods Research Be Completed Within a Short Thesis Timeline?
→

339
comparative research question Does Your Research Question Actually Require a Comparison?
→
340
baseline differences between groups What Happens When the Groups You Compare Are Different Before the Study Begins?
→
341
identify comparison research question How Do You Identify the Exact Comparison Needed to Answer Your Research Question?
→
342
choosing units of comparison in research design Should Your Research Design Compare People, Groups, Time Points, Conditions, Places, or Exposures?
→
343
within-participant vs between-participant comparisons Should Your Research Design Use Within-Participant or Between-Participant Comparisons?
→
344
concurrent vs historical comparisons research Should Your Research Design Use Concurrent or Historical Comparisons?
→
345
group comparability in research design What Makes Two Groups Comparable Enough for a Valid Research Comparison?
→
346
comparison groups differ only on factor of interest Should Comparison Groups Differ Only on the Factor of Interest?
→
347
perfect group comparability in research When Is Perfect Comparability Between Research Groups Impossible?
→
348
comparative study with baseline differences How Do You Design a Comparative Study Around Unavoidable Baseline Differences?
→
349
scientifically meaningful statistically difficult comparisons Can a Research Comparison Be Scientifically Meaningful but Statistically Difficult?
→
350
research design without comparison group When Is Having No Comparison Group the Correct Research Design Choice?
→

351
correlation vs causation Correlation, Association, Prediction, and Causation: What Is Your Study Actually Designed to Establish?
→
352
counterfactual in causal research What Is a Counterfactual, and Why Does Causal Research Depend on One?
→
353
temporal order in causal research Why Is Temporal Order Important for Making Causal Claims?
→
354
observational study causal inference When Can an Observational Study Support a Causal Claim?
→
355
association vs causation research design How Do You Know When Your Design Supports Association but Not Causation?
→
356
research design features causal interpretation What Research Design Features Strengthen a Causal Interpretation?
→
357
temporal order enough establish causation Is Temporal Order Enough to Establish Causation in Research?
→
358
statistical adjustment causation observational research Is Statistical Adjustment Enough to Establish Causation in Observational Research?
→
359
randomization poor treatment adherence causal claims Is Randomization Enough to Support Causal Claims When Treatment Adherence Is Poor?
→
360
dose-response relationship causal interpretation Does a Strong Dose-Response Relationship Strengthen Causal Interpretation?
→
361
replication across designs causal interpretation Does Replication Across Different Research Designs Strengthen Causal Interpretation?
→
362
causal study alternative explanations How Do You Design a Causal Study to Address the Strongest Alternative Explanation?
→
363
observational causal studies hypothetical target trial Should Observational Causal Studies Be Designed Around a Hypothetical Target Trial?
→
364
target trial emulation What Is Target Trial Emulation, and When Is It Useful?
→
365
avoid causal language study design When Should Researchers Avoid Causal Language at the Study Design Stage?
→

568
research population and sample How to Define Your Population and Choose the Right Sample
→
569
target population vs accessible population Target Population vs. Accessible Population: Who Are You Actually Studying?
→
570
sample vs population in research Sample vs. Population: What Exactly Are You Trying to Learn About?
→
571
sampling frame population mismatch What Is a Sampling Frame, and What Happens When It Doesn’t Match Your Population?
→
572
defining target population in research How Do You Define the Target Population for Your Research?
→
573
target population vs accessible population vs study sample Target Population vs. Accessible Population vs. Study Sample: What’s the Difference?
→
574
target population scope How Broad Should the Target Population Be?
→
575
target population before study site selection Should the Target Population Be Defined Before Choosing Study Sites?
→
576
accessible population target population differences Can the Accessible Population Be Too Different from the Target Population?
→
577
accessible population narrower than target population What Should You Do When Your Accessible Population Is Narrower Than Your Target Population?
→
578
geography target population definition Should Geography Be Part of the Target Population Definition?
→
579
time period target population definition Should Time Period Be Part of the Target Population Definition?
→
580
disease stage severity experience population definition Should Disease Stage, Severity, or Experience Be Part of the Population Definition?
→
581
narrow population validity generalizability When Does a Narrowly Defined Population Improve Validity but Reduce Generalizability?
→

582
inclusion and exclusion criteria What Are Inclusion and Exclusion Criteria, and How Restrictive Should They Be?
→
583
eligibility criteria and generalizability How Do Inclusion and Exclusion Criteria Change the Population Your Findings Apply To?
→
584
inclusion and exclusion criteria When Do Inclusion and Exclusion Criteria Create an Unrepresentative Sample?
→
585
writing inclusion criteria research question How Do You Write Inclusion Criteria That Actually Match the Research Question?
→
586
factors determining inclusion criteria What Factors Should Determine Inclusion Criteria in Research?
→
587
factors determining exclusion criteria What Factors Should Determine Exclusion Criteria in Research?
→
588
safety concerns exclusion criteria Should Every Safety Concern Become an Exclusion Criterion?
→
589
confounders exclusion criteria Should Every Potential Confounder Become an Exclusion Criterion?
→
590
excessive exclusion criteria sample representativeness Can Too Many Exclusion Criteria Make a Research Sample Unrealistic?
→
591
insufficient eligibility criteria sample heterogeneity Can Too Few Eligibility Criteria Make a Research Sample Too Heterogeneous?
→
592
research eligibility assessment methods Should Research Eligibility Be Based on Self-Report, Records, Testing, or Clinician Judgment?
→
593
borderline eligibility research participants How Do You Handle Borderline Eligibility in Research Participant Selection?
→
594
changing eligibility criteria slow recruitment Should Eligibility Criteria Be Changed if Recruitment Is Slower Than Expected?
→
595
eligibility criteria changes target population When Does Changing Eligibility Criteria Change the Target Population?
→
596
exclusion criteria underrepresented groups How Do You Prevent Exclusion Criteria from Unnecessarily Excluding Underrepresented Groups?
→

597
choosing sampling method research How to Choose a Sampling Method That Actually Fits Your Study
→
598
probability vs nonprobability sampling methods What Makes a Sampling Method Probability-Based or Non-Probability-Based?
→
599
probability vs non-probability sampling Probability vs. Non-Probability Sampling: Which Sampling Method Should You Use?
→
600
probability sampling methods Simple Random, Stratified, Cluster, and Systematic Sampling: Which Probability Method Fits Your Study?
→
601
non-probability sampling methods Convenience, Purposive, Quota, and Snowball Sampling: When Is Non-Probability Sampling Defensible?
→
602
does a bigger sample make a study better Does a Bigger Sample Automatically Make a Study Better?
→
603
representative sample What Is a Representative Sample, and Does Your Study Actually Need One?
→
604
large sample bias Can a Sample Be Large but Still Seriously Biased?
→
605
representativeness sampling strategy Should Representativeness Be the Main Goal of Your Sampling Strategy?
→
606
does every research study need a representative sample Does Every Research Study Need a Representative Sample?
→
607
nonrepresentative sample research validity Can a Nonrepresentative Sample Still Answer the Research Question Well?
→
608
sampling for population estimation causal inference prediction Should Sampling Be Optimized for Population Estimation, Causal Inference, Prediction, or Conceptual Depth?
→
609
sampling without complete sampling frame How Do You Choose a Sampling Strategy When No Complete Sampling Frame Exists?
→
610
sampling hidden hard-to-reach populations How Do You Choose a Sampling Strategy for Hidden or Hard-to-Reach Populations?
→
611
sampling small population subgroups How Do You Choose a Sampling Strategy When Important Subgroups Are Very Small?
→
612
sampling entire population census When Is Sampling the Entire Population Feasible and Preferable?
→

626
when is convenience sampling defensible When Is Convenience Sampling Defensible?
→
627
convenience sampling Is Convenience Sampling Always Bad? When Can a Practical Sample Still Be Useful?
→
628
when is purposive sampling defensible When Is Purposive Sampling Defensible?
→
629
when is snowball sampling defensible When Is Snowball Sampling Defensible?
→
630
when is quota sampling defensible When Is Quota Sampling Defensible?
→
631
consecutive vs convenience sampling When Is Consecutive Sampling Better Than Convenience Sampling?
→
632
choosing a non-probability sampling method How Do You Choose the Most Appropriate Non-Probability Sampling Method for Your Study?
→
633
non-probability sampling population prevalence Can a Non-Probability Sample Estimate Population Prevalence?
→
634
non-probability sampling causal inference Can a Non-Probability Sample Support Causal Inference?
→
635
reducing non-probability sampling limitations How Can Research Design Reduce the Limitations of Non-Probability Sampling?
→
636
setting sampling quotas for population groups When Should You Set Sampling Quotas for Important Population Groups?
→
637
quota sampling convenience sample representativeness Can Quota Sampling Make a Convenience Sample Representative?
→
638
avoiding easily accessible participant bias How Do You Avoid Recruiting Only Easily Accessible Participants?
→
639
convenience recruitment selection bias When Does Convenience-Based Recruitment Create Unacceptable Selection Bias?
→

653
sample size and statistical power How Many Participants Do You Need for Adequate Statistical Power?
→
654
estimating sample size without formal calculation How Do You Estimate Sample Size When No Formal Calculation Is Available?
→
655
factors determining research sample size What Determines the Sample Size a Study Actually Needs?
→
656
formal sample size calculation quantitative research Does Every Quantitative Study Need a Formal Sample Size Calculation?
→
657
statistical power in study design What Is Statistical Power, and Why Does It Matter for Study Design?
→
658
effect size sample size calculation What Is Effect Size, and Why Does the Expected Effect Affect Sample Size?
→
659
significance level alpha sample size What Is Significance Level, and Why Does Alpha Affect Sample Size?
→
660
one-sided vs two-sided tests sample size One-Sided vs. Two-Sided Tests: How Do They Affect Sample Size?
→
661
outcome variability sample size How Does Outcome Variability Affect Sample Size?
→
662
outcome prevalence sample size How Does Outcome Prevalence Affect Sample Size?
→
663
number of groups sample size How Does the Number of Groups Affect Sample Size?
→
664
unequal allocation ratio sample size How Does an Unequal Allocation Ratio Affect Sample Size?
→
665
repeated measures sample size How Do Repeated Measures Affect Sample Size Requirements?
→
666
clustering effect on sample size How Does Clustering Affect Sample Size?
→
667
design effect sample size calculation What Is the Design Effect, and When Do You Need It?
→
668
adjusting sample size for dropout and attrition How Do You Adjust Sample Size for Expected Dropout or Attrition?
→
669
adjusting sample size for nonresponse How Do You Adjust Sample Size for Nonresponse?
→
670
sample size based on primary outcome Should Sample Size Be Based Only on the Primary Outcome?
→
671
multiple outcomes different sample size requirements What Should You Do When Different Study Outcomes Require Very Different Sample Sizes?
→
672
calculated sample size impossible to recruit What Should You Do When the Calculated Sample Size Is Impossible to Recruit?
→
673
revising study design unrealistic sample size Should You Revise the Research Question, Design, Outcome, or Effect Size Assumption When the Required Sample Size Is Unrealistic?
→

700
qualitative sample size How Many Participants Does Qualitative Research Need? Saturation, Information Power, and the Myth of a Magic Number
→
701
determine appropriate qualitative sample size How Do You Determine an Appropriate Qualitative Sample Size?
→
702
qualitative research sample size calculation Does Qualitative Research Need a Sample-Size Calculation?
→
703
data saturation qualitative sample size planning What Does Data Saturation Mean for Qualitative Sample-Size Planning?
→
704
saturation qualitative research methodologies Is Saturation Appropriate for Every Qualitative Research Methodology?
→
705
information power qualitative sample size What Is Information Power, and When Is It Useful for Qualitative Sample-Size Planning?
→
706
research aim qualitative sample size How Does the Research Aim Affect Qualitative Sample Size?
→
707
sample specificity qualitative sample size How Does Sample Specificity Affect Qualitative Sample Size?
→
708
interview quality qualitative sample size How Does Interview Quality Affect the Number of Participants Needed in Qualitative Research?
→
709
thesis qualitative sample size range Should a Thesis Predetermine a Qualitative Sample-Size Range?
→
710
data saturation few qualitative interviews What Should You Do When Data Saturation Is Claimed After Very Few Interviews?
→
711
excessive qualitative sample size analytical depth Can Too Many Qualitative Participants Reduce Analytical Depth?
→
712
when stop qualitative participant recruitment When Should Participant Recruitment Stop in Qualitative Research?
→

745
how to choose a data collection method How Do You Choose a Data Collection Method That Actually Fits Your Research Question?
→
746
surveys vs interviews vs focus groups vs observation Surveys, Interviews, Focus Groups, and Observation: Choosing a Data Collection Method
→
747
self-report vs objective measures Self-Report vs. Objective Measures: Which Kind of Evidence Should You Use?
→
748
direct vs indirect evidence in research Direct vs. Indirect Evidence: When Are You Measuring the Thing You Actually Care About?
→
749
data collection trade-offs What Are the Trade-Offs Between Depth, Breadth, Standardization, and Flexibility in Data Collection?
→
750
how to operationalize a construct How Do You Turn a Construct Into Something You Can Actually Measure?
→
751
conceptual and operational definitions How Do Your Conceptual and Operational Definitions Guide Measurement?
→
752
measure vs instrument vs indicator Measure vs. Instrument vs. Indicator: What’s the Difference?
→
753
direct vs indirect measures Direct vs. Indirect Measures: When Can’t You Measure the Thing You Actually Care About?
→
754
objective vs subjective measures Objective vs. Subjective Measures: Is One Really Better Than the Other?
→
755
self-report vs observed measures Self-Report vs. Observed or Recorded Measures: What Changes?
→
756
single-item vs multi-item measures Single-Item vs. Multi-Item Measures: How Much Measurement Is Enough?
→
757
levels of measurement What Are Levels of Measurement, and Do Nominal, Ordinal, Interval, and Ratio Still Matter?
→
758
multiple ways to measure a construct Can the Same Construct Be Measured in Several Valid Ways?
→
759
incomplete construct measurement What Happens When Your Measure Captures Only Part of the Construct?
→
760
how to select variables and outcomes in research How Do You Decide Which Variables and Outcomes to Measure in a Research Study?
→
761
should every conceptual framework variable be measured Should Every Variable in the Conceptual Framework Be Measured?
→
762
collecting all available research variables Should Researchers Collect Every Available Variable?
→
763
essential variables for primary research question Which Variables Are Essential for Answering the Primary Research Question?
→
764
descriptive variables for study sample Which Variables Should Be Measured to Describe the Study Sample?
→
765
variables to control for confounding Which Variables Should Be Measured to Control for Confounding?
→
766
variables to investigate causal mechanisms Which Variables Should Be Measured to Investigate Causal Mechanisms?
→
767
variables for effect heterogeneity and moderation Which Variables Should Be Measured to Examine Effect Heterogeneity or Moderation?
→
768
excessive variable collection participant burden When Does Collecting More Variables Increase Participant Burden Without Adding Scientific Value?
→
769
insufficient variable measurement research question Can Measuring Too Few Variables Make a Research Question Impossible to Answer?
→

770
appropriate outcome measure for research question What Makes an Outcome Measure Appropriate for a Research Question?
→
771
should every research study have one primary outcome Should Every Research Study Have One Primary Outcome?
→
772
multiple primary outcomes in research Can a Research Study Have Multiple Primary Outcomes?
→
773
multiple primary outcomes statistical interpretation When Do Multiple Primary Outcomes Create Problems for Statistical Analysis and Interpretation?
→
774
primary vs secondary outcomes in research What Is the Difference Between Primary and Secondary Outcomes in Research?
→
775
prespecify exploratory outcomes Should Exploratory Outcomes Be Specified Before Data Collection?
→
776
researcher-important vs participant-relevant outcomes Can a Research Outcome Be Important to Researchers but Irrelevant to Participants?
→
777
patient-important and stakeholder-important outcome selection Should Patient-Important and Stakeholder-Important Outcomes Influence Outcome Selection?
→
778
surrogate outcomes in research Should Researchers Use Surrogate Outcomes When Final Outcomes Take Too Long to Measure?
→
779
surrogate outcome validity and indirectness When Is a Surrogate Outcome Too Indirect to Be Scientifically Useful?
→
780
objective outcome measurement in research Should Research Outcomes Be Measured Objectively Whenever Possible?
→
781
subjective primary outcome appropriateness Can a Subjective Outcome Be the Most Appropriate Primary Outcome?
→

810
when to develop a new research instrument When Should You Develop a New Research Instrument Instead of Using an Existing One?
→
811
instrument development separate study Should Research Instrument Development Be Conducted as a Separate Study?
→
812
define construct before instrument development How Clearly Must a Research Construct Be Defined Before Developing Instrument Items?
→
813
sources of questionnaire items during development Where Should Questionnaire Items Come From During Instrument Development?
→
814
expert review instrument items before pilot testing Should Experts Review Research Instrument Items Before Pilot Testing?
→
815
target population review instrument items Should Members of the Target Population Review Research Instrument Items Before Use?
→
816
cognitive interviewing questionnaire development What Is Cognitive Interviewing, and When Should It Be Used in Questionnaire Development?
→
817
how many response options questionnaire item How Many Response Options Should a Questionnaire Item Have?
→
818
reverse-worded questionnaire items Should You Include Reverse-Worded Items in a Research Questionnaire?
→
819
redundant questionnaire items measurement quality Can Too Many Similar Questionnaire Items Reduce Measurement Quality?
→
820
reliability and validity new instrument main study Should Reliability and Validity Evidence Be Established Before Using a New Instrument in the Main Study?
→
821
risks newly developed instrument main study When Is It Too Risky to Use a Newly Developed Instrument in the Main Study?
→

862
generalizability in research Can Your Findings Be Generalized? External Validity, Transferability, and the Limits of Your Sample
→
863
internal vs external validity Internal vs. External Validity: What Kind of Validity Does Your Study Actually Need?
→
864
internally valid but not generalizable Can a Study Be Internally Valid but Not Generalizable?
→
865
internal validity vs generalizability Can Improving Internal Validity Reduce Generalizability?
→
866
target population research generalizability To Which Population Should Your Research Findings Be Generalized?
→
867
sample representativeness target population Does Your Study Sample Need to Resemble the Target Population?
→
868
strict eligibility criteria external validity Can Strict Eligibility Criteria Undermine the Real-World Usefulness of Research Findings?
→
869
controlled studies internal external validity Can a Highly Controlled Study Have Strong Internal Validity but Weak External Validity?
→
870
multisite research generalizability Does Multisite Research Automatically Improve Generalizability?
→
871
number of research sites contextual variation How Many Research Sites Are Needed to Capture Meaningful Contextual Variation?
→
872
research site selection diversity convenience Should Research Sites Be Selected for Diversity Rather Than Convenience?
→
873
generalizability without statistical representativeness Can Research Findings Generalize Beyond the Study Setting Without Statistical Representativeness?
→
874
transportability vs generalizability What Is Transportability in Research, and How Does It Differ from Generalizability?
→
875
design research applicability different settings How Do You Design a Study So Others Can Assess Whether Its Findings Apply to Different Settings?
→

876
measurement change research question Can the Way You Measure Something Change the Research Question You Are Actually Answering?
→
877
reliability vs validity Reliability vs. Validity: How Do You Know Your Research Measures What It Should?
→
878
types of validity Construct, Content, Criterion, and Face Validity: What’s the Difference?
→
879
reliable but not valid Can a Measure Be Reliable but Not Valid?
→
880
validated instrument study validity Does Using a Validated Instrument Make Your Study Valid?
→
881
validity evidence across populations Validated for Whom? Why Validity Evidence May Not Automatically Transfer Across Populations
→
882
manipulating measuring intended construct Does Your Study Actually Manipulate or Measure the Intended Construct?
→
883
intervention active components construct validity Can an Intervention's Name Conceal Multiple Active Components?
→
884
measuring related vs intended construct Can a Research Instrument Measure a Related Construct Instead of the Intended Construct?
→
885
participant interpretation survey items Can Participants Interpret the Same Survey or Questionnaire Item Differently?
→
886
narrow operationalization construct validity Can Operationalizing a Complex Construct Too Narrowly Threaten Construct Validity?
→
887
multiple measures construct validity Can Using Multiple Measures Strengthen Construct Validity?
→
888
triangulation construct validity Can Triangulation Strengthen Confidence That a Research Construct Was Adequately Captured?
→
889
design evidence construct validity What Design Evidence Is Needed to Establish That a Study Tested Its Intended Construct?
→

911
confounding in research What Is Confounding, and Why Can It Distort a Relationship?
→
912
statistical adjustment confounding Why Doesn’t Statistical Adjustment Automatically Fix Confounding?
→
913
effect modifiers moderators confounders What Are Effect Modifiers and Moderators, and Why Aren’t They the Same as Confounders?
→
914
identify potential confounders Which Potential Confounders Should You Identify Before Conducting a Study?
→
915
restriction to reduce confounding Should You Restrict Participant Eligibility to Reduce Confounding?
→
916
participant matching to reduce confounding Should You Match Participants to Reduce Confounding?
→
917
stratified sampling vs stratified randomization Should You Use Stratified Sampling or Stratified Randomization to Address Confounding?
→
918
measuring variables for statistical adjustment Should You Measure a Variable Just Because You Might Adjust for It Later?
→
919
insufficient confounder measurement Can Measuring Too Few Confounders Undermine Causal Inference?
→
920
excessive variable measurement and overadjustment Can Measuring Too Many Variables Encourage Unnecessary Statistical Adjustment?
→
921
mediator and collider adjustment bias Can Adjusting for Mediators or Colliders Introduce Bias?
→
922
confounding control strategy Should You Plan Your Confounding Control Strategy Before Data Collection?
→
923
reporting confounding control limitations How Do You Explain Which Confounders Your Research Design Can and Cannot Address?
→

1007
community-based participatory research What Is Community-Based Participatory Research?
→
1008
participatory research vs traditional research Participatory Research vs. Traditional Research: What Changes?
→
1009
co-production in research What Does Co-Production Mean in Research?
→
1010
research partner influence study decisions How Much Influence Should Research Partners Have Over Study Decisions?
→
1011
tokenism in research When Does Consultation Become Tokenism?
→
1012
research partner compensation How Should Community or Patient Research Partners Be Compensated?
→
1013
research partners authorship Should Research Partners Qualify for Authorship?
→
1014
stakeholder disagreement research design What Should Researchers Do When Stakeholders Disagree About How the Study Should Be Designed?
→
1015
research partners vs stakeholder advisors When Should Stakeholders Become Research Partners Rather Than Advisors?
→
1016
shared decision-making with research partners Which Research Decisions Can Research Partners Legitimately Share?
→
1017
community research partner veto power Should Community Research Partners Have Veto Power Over Study Decisions?
→
1018
shared research decision-making and scientific accountability How Do You Share Research Decision-Making While Maintaining Clear Scientific Accountability?
→
1019
participatory research randomized quantitative designs Can Participatory Research Use Randomized or Quantitative Research Designs?
→
1020
scientific independence in co-produced research Can Co-Produced Research Maintain Independence When Partners Have Preferred Outcomes?
→
1021
conflict resolution in participatory research How Do You Establish Conflict-Resolution Procedures in Participatory Research?
→
1022
community partner involvement in data collection decisions Should Community Research Partners Help Decide What Data Are Collected?
→
1023
community partner involvement in research interpretation Should Community Research Partners Help Decide How Findings Are Interpreted?
→
1024
prevent tokenism in participatory research How Do You Prevent Tokenistic Participation in Participatory Research?
→

1025
plan data analysis before data collection Should You Decide How You’ll Analyze the Data Before You Collect It?
→
1026
analysis plan before data collection What Should an Analysis Plan Decide Before Data Collection Begins?
→
1027
analysis research question design alignment How Do You Know Whether Your Planned Analysis Actually Matches Your Research Question and Design?
→
1028
research question planned analysis Should Every Research Question Have a Planned Analysis?
→
1029
hypothesis corresponding analysis Should Every Hypothesis Have a Corresponding Analysis?
→
1030
variables in analysis plan How Should Your Variables and Their Roles Shape the Analysis Plan?
→
1031
statistical test vs study design Should Your Statistical Test Influence Your Study Design, or Should the Design Come First?
→
1032
choose statistical test before data collection Should You Choose the Statistical Test Before Collecting the Data?
→
1033
don't know how to analyze data What Happens If You Collect Data You Don’t Know How to Analyze?
→
1034
multiple analyses same research question What Should You Do When More Than One Analysis Could Answer the Same Research Question?
→
1035
analysis plan flexibility What Parts of an Analysis Plan Can Legitimately Remain Flexible?
→
1036
when to involve a statistician in research When Should a Statistician or Methodologist Be Involved in Study Design?
→
1037
statistical analysis plan detail How Detailed Should Your Statistical Analysis Plan Be Before Data Collection?
→
1038
prespecify primary analysis before recruitment Should the Primary Analysis Be Specified Before Participant Recruitment Begins?
→
1039
prespecify secondary analyses Should Secondary Analyses Be Planned Before Data Collection?
→
1040
prespecify subgroup analyses Should Subgroup Analyses Be Planned Before Data Collection?
→
1041
sensitivity analysis research design planning Should Sensitivity Analyses Be Planned During Research Design?
→
1042
missing data handling before data collection Should Missing-Data Handling Be Planned Before Data Collection?
→
1043
clustering repeated measures sample size Should Clustering and Repeated Measures Be Considered Before Sample Size Planning?
→
1044
analysis plan research design limitations Can an Analysis Plan Reveal That Your Research Design Cannot Answer the Research Question?
→
1045
redesign study analysis feasibility When Should You Redesign a Study Because the Required Analysis Is Not Feasible or Defensible?
→

1046
qualitative analysis plan before data collection Do Qualitative Studies Need an Analysis Plan Before Data Collection?
→
1047
qualitative analysis plan What Should a Qualitative Analysis Plan Specify in Advance?
→
1048
choosing qualitative data analysis approach before data collection Should You Choose Your Qualitative Data Analysis Approach Before Collecting Data?
→
1049
qualitative analysis approach and data collection methods How Should Your Qualitative Analysis Approach Influence Data Collection Methods?
→
1050
changing qualitative analysis approach during data collection Can You Change Your Qualitative Data Analysis Approach After Data Collection Begins?
→
1051
inductive vs deductive qualitative coding Should Qualitative Coding Be Inductive, Deductive, or Both?
→
1052
qualitative codebook before data collection Should You Develop a Qualitative Codebook Before Data Collection?
→
1053
qualitative analysis planning interview questions How Should Your Planned Qualitative Analysis Inform Interview Questions?
→
1054
iterative sampling qualitative data analysis When Does Qualitative Data Analysis Require Iterative Sampling?
→
1055
field notes reflexive memos qualitative analysis When Does Qualitative Data Analysis Require Field Notes or Reflexive Memos?
→
1056
multiple coders qualitative data analysis Should You Plan to Use Multiple Coders in Qualitative Data Analysis?
→
1057
qualitative analysis research team expertise What If Your Planned Qualitative Analysis Requires Expertise Your Research Team Lacks?
→

1069
test research design before main study Should You Test Your Research Design Before Starting the Main Study?
→
1070
pilot study vs feasibility study Pilot Study vs. Feasibility Study: What’s the Difference?
→
1071
what should a pilot study test What Exactly Should a Pilot Study Test?
→
1072
pilot study conclusions What Shouldn’t You Conclude From a Pilot Study?
→
1073
pretest vs pilot study vs feasibility study Pretest vs. Pilot Study vs. Feasibility Study: What’s the Difference?
→
1074
parts of a study to test before full study Which Parts of a Study Can Be Tested Before the Full Study Begins?
→
1075
test participant understanding study procedures How Can You Test Whether Participants Understand the Study Procedures?
→
1076
data collection procedures practicality How Do You Know Whether Data Collection Procedures Are Practical?
→
1077
pilot study sample size Can a Pilot Study Be Too Small to Be Useful?
→
1078
test planned analysis on pilot data Should You Test Your Planned Analysis on Pilot Data?
→
1079
include pilot data in main study Can You Include Pilot Study Participants or Data in the Main Study?
→
1080
pilot study design not feasible What If Your Pilot Study Shows That Your Original Design Won’t Work?
→
1081
study changes after pilot How Much Should a Study Change After a Pilot Before It Becomes a Different Study?
→
1082
when to choose pilot study over feasibility study When Is a Pilot Study More Appropriate Than a Feasibility Study?
→
1083
interpreting pilot study findings limitations How Do You Distinguish Useful Pilot Study Findings From Conclusions a Pilot Cannot Support?
→
1084
prioritizing research procedures pilot study Which Research Procedures Should You Prioritize When Planning a Pilot Study?
→
1085
pilot testing participant recruitment Should You Pilot Test Participant Recruitment Procedures?
→
1086
pilot testing informed consent procedures Should You Pilot Test Informed Consent Procedures?
→
1087
pilot testing research questionnaires Should You Pilot Test Research Questionnaires Before the Main Study?
→
1088
pilot testing qualitative interview guides Should You Pilot Test Interview Guides Before Qualitative Data Collection?
→
1089
pilot testing data entry management procedures Should You Pilot Test Data Entry and Data Management Procedures?
→
1090
pilot testing randomization procedures Should You Pilot Test Randomization Procedures Before a Trial?
→
1091
pilot testing intervention delivery Should You Pilot Test Intervention Delivery Before the Main Study?
→
1092
pilot testing outcome assessment Should You Pilot Test Outcome Assessment Procedures?
→
1093
testing data analysis pipeline dummy pilot data Should You Test Your Data Analysis Pipeline Using Dummy or Pilot Data?
→

1094
do I need a pilot study Do You Need a Pilot or Feasibility Study Before Your Main Research?
→
1095
what should a feasibility study tell you What Exactly Should a Feasibility Study Tell You?
→
1096
recruitment feasibility How Do You Decide Whether Recruitment Is Feasible Before Committing to the Main Study?
→
1097
when separate feasibility study is needed When Is a Separate Feasibility Study Necessary Before the Main Research?
→
1098
feasibility questions before definitive study What Feasibility Questions Should You Answer Before Conducting a Definitive Study?
→
1099
recruitment rate feasibility study outcome Should Recruitment Rate Be an Outcome in a Feasibility Study?
→
1100
participant retention rate feasibility study Should Participant Retention Rate Be an Outcome in a Feasibility Study?
→
1101
intervention adherence feasibility study Should Intervention Adherence Be an Outcome in a Feasibility Study?
→
1102
data completeness feasibility study Should Data Completeness Be an Outcome in a Feasibility Study?
→
1103
participant acceptability feasibility study Should Participant Acceptability Be an Outcome in a Feasibility Study?
→
1104
cost and resource use feasibility study Should Cost and Resource Use Be Outcomes in a Feasibility Study?
→
1105
feasibility study progression criteria What Progression Criteria Should Determine Whether a Feasibility Study Leads to the Main Study?
→
1106
green amber red feasibility progression criteria Should Feasibility Study Progression Criteria Use a Green-Amber-Red System Instead of Pass-Fail?
→
1107
feasibility study decision not to proceed Can a Feasibility Study Show That a Definitive Study Should Not Proceed?
→
1108
repeating feasibility study after research redesign When Should You Repeat a Feasibility Study After Redesigning Your Research?
→

1109
what is preregistration What Is Preregistration, and What Problem Is It Supposed to Solve?
→
1110
what to preregister What Goes Into a Research Preregistration? A Guide to Hypotheses, Sampling, Variables, Exclusions, and Analyses
→
1111
can a preregistered study change Does Preregistration Mean That Nothing in the Study Can Change?
→
1112
what can change after preregistration What Can Still Change After a Study Has Been Preregistered?
→
1113
protocol vs preregistration Protocol vs. Preregistration: What’s the Difference?
→
1114
does every study benefit from preregistration Does Every Kind of Research Benefit From Preregistration?
→
1115
qualitative research preregistration Can Qualitative Research Be Preregistered?
→
1116
exploratory research preregistration Can Exploratory Research Be Preregistered?
→
1117
exploratory vs confirmatory research Exploratory vs. Confirmatory Research: Do You Have to Decide Before Collecting the Data?
→
1118
preregistration deviations Can You Deviate From a Preregistered Study Without Doing Something Wrong?
→
1119
document preregistration deviations How Should Deviations From a Preregistered Plan Be Documented?
→
1120
does preregistration make research more rigorous Does Preregistration Automatically Make a Study More Rigorous?
→
1121
preregistration and registered reports Preregistration and Registered Reports: Should You Commit to Your Study Plan Before Seeing the Results?
→
1122
what can change after preregistration Which Parts of a Research Preregistration Must Remain Fixed, and Which Can Be Changed?
→
1123
research decisions to prespecify Which Research Design and Analysis Decisions Are Most Important to Prespecify?
→
1124
preregistering primary outcome Should You Preregister the Primary Outcome of Your Study?
→
1125
preregistering inclusion and exclusion criteria Should You Preregister Participant Inclusion and Exclusion Criteria?
→
1126
preregistering sample size and stopping rules Should You Preregister Sample Size and Data Collection Stopping Rules?
→
1127
preregistering data exclusion rules Should You Preregister Data Exclusion Rules Before Analysis?
→
1128
preregistering subgroup analyses Should You Preregister Planned Subgroup Analyses?
→
1129
qualitative research preregistration What Should You Preregister in a Qualitative Research Study?
→

1157
research protocol contents What Should a Research Protocol Actually Include?
→
1158
research protocol What Is a Research Protocol, and Why Should the Study Design Be Written Down Before Data Collection?
→
1159
research protocol level of detail How Detailed Should a Research Protocol Be?
→
1160
research protocol vs research proposal Research Protocol vs. Research Proposal: What’s the Difference?
→
1161
study decisions before data collection Which Study Decisions Should Be Fixed Before Data Collection Begins?
→
1162
flexible research decisions What Can Remain Flexible in a Research Protocol?
→
1163
research protocol alignment How Do You Make Sure the Protocol Matches the Research Questions, Objectives, and Hypotheses?
→
1164
align research methods How Do You Make Sure the Sampling, Measurement, Data Collection, and Analysis Plans Fit Together?
→
1165
research protocol version What Is a Protocol Version, and Why Should Changes Be Tracked?
→
1166
research protocol review Who Should Review the Study Protocol Before the Research Begins?
→
1167
finalize research protocol When Is a Research Protocol Ready to Be Finalized?
→
1168
research protocol requirements before data collection What Must Be Included in a Research Protocol Before Data Collection Begins?
→
1169
operational detail in research protocols How Much Operational Detail Should a Research Protocol Provide?
→
1170
prespecifying operational decisions in research protocols Should a Research Protocol Specify Every Operational Decision in Advance?
→
1171
contingency planning in research protocols Should a Research Protocol Include Contingency Plans for Unexpected Problems?
→
1172
participant recruitment plan in research protocols Should a Research Protocol Include a Participant Recruitment Plan?
→
1173
data quality assurance plan in research protocols Should a Research Protocol Include a Data Quality Assurance Plan?
→
1174
statistical and qualitative analysis plans in research protocols Should a Research Protocol Include a Statistical or Qualitative Data Analysis Plan?
→
1175
research dissemination plan in research protocols Should a Research Protocol Include Plans for Disseminating Findings?
→
1176
research protocol readiness for ethics and governance review When Is a Research Protocol Ready for Ethics and Governance Review?
→

1177
research design budget constraints What Should You Do When the Ideal Research Design Exceeds Your Budget?
→
1178
when research data cannot be collected What Should You Do When the Best Evidence for Your Question Cannot Realistically Be Collected?
→
1179
research design time constraints What Should You Do When the Ideal Research Design Exceeds Your Available Timeline?
→
1180
research design limited team expertise What Should You Do When the Ideal Research Design Requires Expertise Your Team Lacks?
→
1181
research design equipment limitations What Should You Do When the Ideal Research Design Requires Equipment You Cannot Access?
→
1182
research design study site limitations What Should You Do When the Ideal Research Design Requires More Study Sites Than You Can Manage?
→
1183
research design participant recruitment challenges What Should You Do When the Ideal Research Design Requires a Sample You Cannot Recruit?
→
1184
simplify research design narrow question or postpone study Should You Simplify the Research Design, Narrow the Research Question, or Postpone the Study?
→
1185
methodologically weak research design When Does a Feasible Research Design Become Too Weak to Justify Conducting the Study?
→
1186
smaller rigorous study vs larger compromised study Is a Smaller, Methodologically Strong Study Better Than a Larger, Compromised Study?
→
1187
when to abandon an infeasible research study When Should You Abandon a Research Study Because No Defensible Design Is Feasible?
→

1275
inclusion and exclusion in research Who Gets Included in Research, and Who Gets Left Out?
→
1276
representation vs representativeness Representation vs. Representativeness: What’s the Difference?
→
1277
diversity in research samples Why Does Diversity in Research Samples Matter?
→
1278
sex vs gender in research Sex vs. Gender in Research: Why Does the Difference Matter?
→
1279
analyze results by sex or gender When Should Research Analyze Results by Sex or Gender?
→
1280
race and ethnicity in research How Should Researchers Think About Race and Ethnicity as Research Variables?
→
1281
demographic categories in research When Can Demographic Categories Oversimplify the People Being Studied?
→
1282
language requirements in research How Can Language Requirements Exclude Important Populations From Research?
→
1283
underrepresentation in research What Is Underrepresentation in Research, and Why Does It Matter?
→
1284
accessible research participation How Can Researchers Make Participation More Accessible?
→
1285
study procedures participant exclusion How Can Study Procedures Unintentionally Exclude Certain Participants?
→
1286
diverse sample representative Does Making a Sample More Diverse Automatically Make It Representative?
→
1287
oversampling underrepresented groups When Is It Appropriate to Deliberately Oversample an Underrepresented Group?
→
1288
inclusive study population How Should Researchers Balance Inclusion With the Need for a Clearly Defined Study Population?
→
1289
population groups excluded by research design Which Population Groups Might Be Systematically Excluded by a Research Design?
→
1290
research eligibility criteria exclusion Do Research Eligibility Criteria Unnecessarily Exclude Older Adults, People With Disabilities, Pregnant People, or Other Groups?
→
1291
internet access exclusion in research Can Requiring Internet Access Exclude Members of the Target Research Population?
→
1292
travel requirements research participant exclusion Can Travel Requirements Exclude Research Participants With Limited Resources?
→
1293
language requirements research participant exclusion Can Language Requirements Exclude Eligible Research Participants?
→
1294
accessible research materials How Do You Make Research Materials Accessible to Participants With Different Literacy and Disability Needs?
→
1295
oversampling underrepresented groups in research Should Underrepresented Groups Be Oversampled to Improve Representation in Research?
→
1296
inclusive research design scientific validity When Does Inclusive Research Design Improve Scientific Validity?
→
1297
inclusive recruitment participant safety feasibility How Do You Balance Inclusive Recruitment With Participant Safety and Study Feasibility?
→
1298
research rigor systematic population exclusion Can a Methodologically Rigorous Study Still Systematically Exclude the Population Most Affected by the Research Problem?
→

When You're Ready to Move On

A defensible design also has ethical responsibilities.

Before data collection begins, researchers need to consider participants, consent, privacy, integrity, and the ethical obligations attached to the study.

Next · Part 05

Doing Research Without Compromising Ethics

Understand research ethics and integrity, protect participants and research data, address informed consent and conflicts of interest, and meet the ethical responsibilities that apply from study planning through publication.

Continue to Part 05 →