03 · What You Need to Know
How Generalization Works in Single-Case Research
What does generalizability mean?
Generalizability concerns whether findings obtained under particular research conditions apply beyond those conditions.
In single-case research, the relevant extension may concern other participants, behaviors, settings, intervention providers, or periods.
For example, an intervention shown to improve one student's task completion may also be effective for other students who share relevant characteristics.
However, the evidence supporting that expectation must be examined.
Generalizability is not a single property that a study either possesses or lacks. It depends on what is being generalized, to whom, and under which conditions.
Researchers should specify the intended scope rather than claim broadly that the findings are either generalizable or nongeneralizable.
What is the difference between internal and external validity?
Internal validity concerns whether the observed evidence supports the proposed causal relationship within the study.
External validity concerns whether that relationship extends to other populations, settings, treatments, or circumstances.
For example, an ABAB experiment may provide convincing evidence that a temporary prompting system changes one student's performance.
That establishes a different claim from saying the same intervention will improve performance among all students requiring academic support.
The second claim requires evidence or assumptions about the relevance of the original case to other individuals.
Strong internal validity can support subsequent generalization, but it does not automatically establish external validity.
Why does one participant not automatically represent a population?
One participant may differ from others in characteristics that influence intervention response.
For example, a student's prior knowledge, motivation, accessibility needs, or instructional environment may affect how well digital prompting works.
A successful intervention for that student does not establish the distribution of treatment effects among other students.
Furthermore, participants in single-case experiments are often selected purposively rather than through probability sampling.
Such selection may be appropriate for the experimental objective, but it does not automatically support design-based estimation of population characteristics.
Researchers should distinguish selecting a case because it is scientifically informative from selecting a representative probability sample.
What is a functional relationship?
A functional relationship refers to evidence that changes in an outcome systematically correspond to manipulation of an intervention under the conditions studied.
For example, an intervention may be introduced at staggered times across several students, with improvement occurring after each respective introduction.
Such a pattern may strengthen evidence that the intervention influences the measured behavior.
However, establishing a functional relationship does not specify how frequently the effect will occur in an unstudied population.
Nor does it necessarily establish that every participant will respond with the same magnitude.
The distinction between functional relationships and population-average effects is fundamental to interpreting single-case research.
How does replication support generalizability?
Replication examines whether a finding can be demonstrated again under the same or systematically varied conditions.
For example, researchers may repeat an intervention with additional students or implement it in different educational settings.
When similar functional relationships appear across relevant replications, confidence may increase that the original effect was not unique to one case.
However, replication does not guarantee universal effectiveness.
Researchers should examine both successful and unsuccessful replications, including differences in participant characteristics and implementation conditions.
The number and quality of replications matter more than merely accumulating repeated observations within one participant.
See how replication contributes to convincing single-case experimental evidence.
What is direct replication?
Direct replication attempts to reproduce an intervention effect under conditions closely resembling those of the original study.
For example, researchers may apply the same prompting intervention to another student with similar learning characteristics using comparable tasks and measurement procedures.
If the effect is reproduced, the finding becomes less dependent on the original participant.
However, direct replications may still involve a narrow range of participants and settings.
They can strengthen confidence in reproducibility under similar conditions without establishing that the intervention works across substantially different circumstances.
What is systematic replication?
Systematic replication deliberately varies relevant conditions to examine whether an intervention effect persists.
For example, researchers may evaluate the same prompting procedure across students of different ages, academic disciplines, or levels of prior knowledge.
They may also examine whether the effect occurs in different instructional environments or when implemented by different teachers.
Systematic replication can help identify the boundaries of an intervention's effectiveness.
However, varying too many conditions simultaneously may make it difficult to determine which differences explain changes in outcomes.
Researchers should select variations according to theoretically relevant effect modifiers and plausible implementation differences.
How do direct and systematic replication differ?
| Feature |
Direct replication |
Systematic replication |
| Primary purpose |
Examine reproducibility under similar conditions. |
Examine whether effects extend across changed conditions. |
| Participants |
Often selected for relevant similarity. |
May vary in theoretically important characteristics. |
| Settings |
Usually comparable to the original setting. |
May deliberately differ. |
| Intervention |
Implemented as similarly as feasible. |
May test robustness across specified variations. |
| Interpretive contribution |
Supports reproducibility. |
Helps identify scope and boundary conditions. |
Both forms of replication can contribute to a cumulative evidence base, but they answer different questions about the applicability of findings.
Can multiple-baseline designs support generalization?
Multiple-baseline designs can provide replicated demonstrations of effects across participants, behaviors, or settings.
For example, an intervention introduced at different times across three students may produce similar changes following each introduction.
This can strengthen evidence of a functional relationship across those students.
However, the implications for generalizability depend on the tier structure.
A design across three behaviors within one participant provides different external-validity evidence from a design involving three distinct participants.
Similarly, replication across settings within one institution does not necessarily establish applicability to different institutions.
The distinctions are examined in multiple-baseline designs across participants, behaviors, and settings.
Does replication across behaviors establish generalization across people?
Not necessarily. Demonstrating an intervention effect across several behaviors within one person may strengthen evidence about the intervention's influence on those behaviors.
However, the study still provides limited direct evidence about how other people would respond.
For example, a digital prompting intervention may improve one student's task initiation, completion, and submission behaviors.
That does not establish that students with different characteristics will experience comparable improvements.
Researchers should distinguish generalization across response classes from generalization across individuals.
Does replication across settings establish generalization across institutions?
Not automatically. An intervention effective in several settings within one institution may remain dependent on that institution's resources, personnel, or instructional practices.
For example, a prompting system may work in classrooms and laboratories supported by the same trained teaching team.
Its effectiveness may differ in institutions with different staffing, technology access, or implementation procedures.
Systematic replication across institutions can provide additional evidence, but the relevant contextual differences should be documented.
Generalization requires attention to the mechanisms and conditions that may influence treatment response.
What role do participant characteristics play?
Participant characteristics may influence intervention response and therefore affect the scope of generalization.
For example, prior knowledge, baseline performance, age, accessibility requirements, or familiarity with technology may alter the effect of an instructional intervention.
These characteristics may function as effect modifiers in a broader causal framework.
However, a few single-case replications usually cannot estimate complex interactions with high precision.
Researchers should identify plausible effect modifiers using theory and prior evidence, then evaluate them systematically across future studies where feasible.
Unexpected differences in response should be investigated rather than dismissed as failures of replication.
Why is intervention fidelity important for generalization?
Intervention fidelity concerns whether the intervention is implemented according to its intended procedures.
If an intervention works in one setting but not another, the difference may reflect participant characteristics, contextual factors, or variation in implementation.
For example, teachers may differ in how consistently they provide prompts or respond to student difficulties.
Researchers should document essential intervention components and relevant adaptations.
However, perfect procedural uniformity is not always desirable when interventions must be adapted appropriately to local conditions.
The important question is which components are necessary for the hypothesized effect and which adaptations preserve the intervention's underlying mechanism.
Can single-case research estimate a population-average treatment effect?
Not automatically. Conventional single-case experimental designs often prioritize demonstrating functional relationships within studied cases.
Estimating a population-average treatment effect requires a clearly defined population, estimand, and assumptions supporting aggregation or extrapolation.
For example, averaging effects across three purposively selected participants does not necessarily estimate the mean treatment effect among all eligible students.
Statistical models may combine single-case effects across studies, but their interpretation depends on participant selection, between-case heterogeneity, measurement comparability, and modeling assumptions.
Researchers should avoid treating the arithmetic mean of a few observed effects as an automatically representative population parameter.
Can meta-analysis improve generalizability?
Meta-analysis can synthesize evidence from multiple single-case experiments when appropriate effect measures and sufficiently comparable information are available.
Such synthesis may help examine overall patterns and variation across participants or studies.
However, single-case effect-size methods differ in their assumptions and interpretation.
Dependence among repeated observations, variation in baseline trends, and differences in experimental designs can complicate synthesis.
Researchers should also consider selective publication, inconsistent reporting, and the representativeness of included cases.
A meta-analysis does not automatically remove limitations shared by its contributing studies.
Nevertheless, a well-conducted synthesis may provide stronger evidence about the distribution and conditions of intervention effects than an isolated experiment.
What is the difference between generalization and transferability?
Generalization commonly concerns whether findings apply beyond the studied units or conditions.
Transferability is often used in qualitative research to emphasize whether findings may be relevant to another context based on sufficiently detailed descriptions and contextual comparison.
For example, a contextual case study may describe an educational intervention's implementation in enough detail for readers to assess its relevance to another institution.
A single-case experiment may instead contribute evidence that a functional relationship is reproduced under particular conditions.
These inferential approaches are not interchangeable, although contextual information can strengthen interpretation in both.
The distinction is relevant to single-case studies versus single-case experimental designs.
What are boundary conditions?
Boundary conditions describe circumstances under which an intervention effect may change, weaken, disappear, or reverse.
For example, digital prompting may improve task completion when students have adequate device access but provide little benefit when connectivity is unreliable.
Similarly, a procedure effective for simple tasks may be less effective for tasks requiring complex reasoning.
Systematic replication can help identify such conditions.
Researchers should not regard a failure to reproduce an effect as scientifically worthless.
When carefully investigated, inconsistent findings may reveal important limits on the intervention's applicability.
Can single-case findings support evidence-based practice?
Yes. A cumulative body of methodologically rigorous single-case experiments may contribute to identifying interventions supported by empirical evidence.
For example, educational evidence standards may evaluate the number, quality, and consistency of demonstrations across studies and research teams.
However, the requirements vary according to the evidence framework being applied.
A single successful experiment should not automatically be described as establishing an evidence-based practice for an entire population.
Researchers should distinguish preliminary intervention evidence from a sufficiently replicated body of research supporting broader recommendations.
The work of Horner and colleagues on single-subject research in special education provides an influential account of how replication contributes to evidence-based practice.
What if intervention effects differ across participants?
Variation in treatment response may be scientifically important.
For example, a prompting intervention may produce substantial improvement for two students but little change for a third.
Researchers should investigate whether differences relate to baseline performance, intervention fidelity, contextual conditions, or other plausible factors.
However, explanations should not be invented after observing inconsistent outcomes.
Where possible, hypotheses about effect modifiers should be specified in advance and evaluated through subsequent replications.
Reporting heterogeneous outcomes transparently may be more informative than averaging them into a single effect that conceals meaningful differences.
How should researchers report generalizability?
Reports should describe participant selection, relevant characteristics, intervention procedures, settings, measurement conditions, and experimental contrasts.
Researchers should identify which conclusions concern the studied cases and which involve extrapolation beyond them.
Replication evidence should be reported transparently, including inconsistent or null findings.
Where broader applicability is proposed, the rationale should identify relevant similarities and differences between studied and target conditions.
Researchers should avoid statements such as "the intervention is effective for all students" when the evidence concerns only a small purposively selected group.
More defensible wording identifies the observed functional relationship and specifies the conditions under which further replication is needed.
How can researchers strengthen generalizability during design planning?
Researchers should first establish a credible experimental design capable of supporting within-case causal inference.
They can then identify the populations and settings to which they eventually want the findings to apply.
Replications may be planned across participants with theoretically relevant differences or across instructional environments that represent important implementation conditions.
Researchers should also standardize essential measurement procedures and document intervention adaptations.
However, generalizability should not be pursued by sacrificing experimental control within individual studies.
A cumulative research program may begin with a narrowly defined intervention effect and progressively examine whether that effect persists under broader conditions.
The resulting evidence is stronger when each replication contributes a clear and interpretable test of the intervention's proposed mechanism.