03 · What You Need to Know
How to Determine a Defensible Number of Randomized Clusters
Why the number of clusters matters independently of participant count
In a cluster-randomized trial, intact groups are assigned to intervention conditions. These groups are the independent units of random allocation, even when outcomes are measured for many individuals within each group.
If 12 schools are randomized and each contributes 200 students, the trial has 12 randomized clusters and 2,400 participating students. The student observations provide information, but their treatment assignments are determined by only 12 school-level allocations.
Participants within schools may share educational resources, teachers, administrative policies, and other influences. Their outcomes can therefore be correlated.
This dependence is one reason cluster randomization usually requires larger samples than comparable individual randomization.
The number of clusters also affects how reliably treatment effects and uncertainty can be estimated. A large participant count does not create additional independent randomization units.
What determines the required number of clusters?
For a conventional parallel, two-arm cluster-randomized trial, the main planning inputs include the primary outcome, target intervention effect, outcome variability, ICC, cluster size, allocation ratio, desired power or precision, and significance level.
The planned statistical analysis also matters, especially when the number of clusters is small.
| Planning factor |
Why it matters |
Practical implication |
| Target effect size |
Smaller effects are harder to detect precisely. |
Smaller target effects generally require more information. |
| ICC |
Higher within-cluster correlation reduces independent information. |
Higher ICC values generally increase cluster requirements. |
| Cluster size |
More participants improve estimation within clusters, with diminishing returns. |
Very large clusters may be inefficient. |
| Outcome variability |
Greater unexplained variation reduces precision. |
More clusters or stronger adjustment may be needed. |
| Allocation ratio |
Unequal allocation can reduce efficiency for a simple treatment comparison. |
Balanced allocation is often efficient when costs and variances are comparable. |
| Analysis method |
Small-sample corrections and model assumptions affect power and inference. |
Power calculations should match the intended method. |
| Cluster attrition |
Withdrawal removes an entire randomized unit from follow-up. |
Allow for plausible loss of clusters. |
Why a fixed minimum such as 10, 20, or 30 clusters is misleading
Rules of thumb can be useful for recognizing potential problems, but they should not be treated as universal design standards.
A trial with 20 clusters may have inadequate power for a small intervention effect and substantial within-cluster correlation. Another trial with fewer clusters may provide useful estimation for a large effect under favorable assumptions, although its inferential limitations still require careful treatment.
The relevant distinction is between the minimum number needed to meet a specified statistical objective and an arbitrary threshold considered acceptable without reference to that objective.
Researchers should therefore avoid claiming that a trial is adequately powered simply because it exceeds a commonly cited cluster count.
A simplified calculation illustrates how cluster requirements arise
For a continuous outcome in a balanced two-arm parallel trial with equal cluster sizes, a simplified normal-approximation formula can illustrate the relationship between the number of clusters and the design parameters.
The calculation is deliberately simplified. It assumes independent clusters, approximately equal cluster sizes, a continuous outcome, a common variance, and a basic unadjusted comparison using normal approximations.
Five clusters per arm should not be interpreted as a general recommendation. With so few clusters, finite-sample corrections and appropriate critical values may materially change the required number. The illustrative formula can underestimate requirements when conventional normal approximations are inappropriate.
A defensible trial calculation should incorporate the planned inferential method, especially when only a small number of clusters is available.
Why increasing cluster size cannot always solve a shortage of clusters
Increasing the number of participants within each cluster can improve precision, but the gain diminishes when outcomes are positively correlated.
For a fixed number of clusters and positive ICC, the variance contribution associated with between-cluster differences cannot be eliminated simply by recruiting more individuals.
Hemming and colleagues describe how power and precision curves can reveal the point at which increasing cluster size provides little additional benefit. They recommend determining cluster number and cluster size jointly rather than independently.
For example, recruiting 100 additional students from each existing school may produce less improvement than recruiting several additional schools with smaller student samples.
The appropriate choice depends on the ICC, target effect, implementation costs, and the number of clusters already available.
Very few clusters create problems beyond low power
Small numbers of clusters can produce unstable treatment-effect estimates, substantial baseline imbalance, and unreliable uncertainty estimates under some conventional analytical methods.
Randomization remains genuine when only a few clusters are assigned, provided the allocation procedure is valid. However, the number of possible allocations is limited, and chance differences between arms may be considerable.
Standard mixed-effects models and generalized estimating equations can perform poorly when small-sample issues are ignored. Depending on the design, suitable corrections, cluster-level analyses, or randomization-based inference may be necessary.
Methodological simulation studies have shown that small-sample corrections can improve control of false-positive error rates, but they may also reduce power relative to uncorrected methods. Consequently, power calculations should incorporate the analysis actually intended.
The distinction between having many observations and having enough independently randomized clusters is particularly important in small trials.
Allocation balance matters when the cluster count is small
Suppose a trial randomizes eight schools, four to each condition. By chance, one arm may contain schools with substantially higher baseline achievement, greater resources, or more experienced teachers.
Such imbalance can occur even when randomization is conducted correctly.
Stratification, matching, or restricted randomization may improve balance on important baseline characteristics. However, the procedures must be planned before allocation and reflected appropriately in the analysis.
Researchers should not use restricted allocation merely to make observed groups appear similar without considering the inferential consequences.
The decision about matching or stratifying clusters should be based on the design's substantive and statistical requirements.
Cluster-size variability affects the required number
Clusters may differ substantially in the number of eligible or recruited participants. A school with 80 students and a school with 500 students each represent one randomized cluster when allocation occurs at the school level.
Unequal sizes can affect efficiency and the weighting of intervention effects. Calculations based only on average cluster size may be misleading when size variability is substantial.
Researchers should estimate the likely distribution of cluster sizes and use an approach compatible with the intended analysis and estimand.
When size variation is large, simulation-based planning may be particularly useful.
Cluster loss requires a separate allowance
Loss of an entire cluster is different from losing several individual participants. A school withdrawing from a trial may remove hundreds of student outcomes and reduce the number of randomized units contributing to the comparison.
Researchers should distinguish expected participant attrition from expected cluster attrition.
If cluster withdrawal is plausible, the planned number of clusters may need to be increased. The allowance should be based on credible assumptions rather than a generic percentage applied without justification.
Power-based and precision-based planning answer different questions
Power calculations determine whether a study is likely to reject a specified null hypothesis under an assumed effect and statistical model. Precision-based calculations focus on the expected uncertainty around the estimated effect, often expressed through confidence interval width.
A trial intended to test a specific effectiveness hypothesis may prioritize power. A trial intended to estimate an intervention effect for policy planning may instead emphasize precision.
Neither approach eliminates the need to account for clustering. The required number of clusters depends on the chosen inferential objective.
For exploratory or feasibility studies, a smaller number of clusters may be appropriate when the objectives are explicitly limited to implementation, recruitment, acceptability, or preliminary parameter estimation. Such studies should not be presented as adequately powered effectiveness trials without supporting evidence.
Simulation may be necessary for complex designs
Analytical formulas are useful for conventional parallel cluster-randomized trials, but more complex arrangements may require simulation.
Examples include repeated measurements, unequal cluster sizes, binary outcomes with low event rates, complex covariate adjustment, restricted randomization, or nonstandard allocation structures.
Simulation involves generating data under plausible assumptions, applying the intended analysis repeatedly, and estimating how often the procedure achieves its statistical objective.
Its validity depends on the assumed data-generating process, parameter values, and analysis method. Simulation should be accompanied by sensitivity analyses when important assumptions are uncertain.
Feasibility must be evaluated alongside statistical requirements
A calculation might indicate that 40 schools are needed, while the research team can recruit only 12. The appropriate response is not simply to increase the number of students per school until the total participant count appears large.
Researchers may need to recruit additional institutions, modify the intervention, revise the target effect or precision objective, use a more efficient design, or reconsider whether a definitive trial is feasible.
Any change to the target effect should be scientifically justified. Increasing the assumed effect merely to reduce the required sample size can produce an inadequately powered trial.
The financial and methodological costs of cluster randomization should therefore be considered before committing to a particular number of institutions.
04 · A Practical Example
Estimating How Many Schools a Trial Might Need
Hypothetical Example
Evaluating a school-wide digital learning intervention
A research team wants to evaluate a school-wide digital learning intervention using a continuous student achievement outcome.
For illustration, the team assumes a target mean difference of five points, an outcome standard deviation of ten points, 40 participating students per school, an ICC of 0.05, 80% power, and a two-sided significance level of 0.05.
The researchers initially use the simplified normal-approximation formula to explore the relationship between cluster number and the target effect.
Specify the outcome and target effect. The primary outcome is achievement score, with a five-point target difference and standard deviation of ten points.
Estimate within-school correlation. The planning ICC is 0.05, based on a hypothetical assumption that must be replaced or supported by relevant evidence in a real trial.
Calculate the approximate design effect. DE = 1 + (40 − 1) × 0.05 = 2.95.
Estimate clusters per arm. The simplified formula gives approximately 4.63 clusters per arm, rounded upward to five before accounting for small-sample inference and other design considerations.
Evaluate small-sample limitations. The team recognizes that ten total clusters may be inadequate under the intended analytical method and performs a more appropriate power calculation incorporating finite-sample procedures.
Assess feasible alternatives. The researchers compare recruiting additional schools, changing the number of students sampled per school, and using prespecified baseline adjustment where justified.
Interpretation: The preliminary calculation provides a starting point, not a definitive requirement of ten schools. A complete analysis may require more clusters because of small-sample inference, uncertainty in the ICC, attrition, and other features of the intended design.
The example also illustrates why the number of clusters cannot be determined from participant count alone. The calculation begins with the outcome, target effect, correlation structure, and inferential objective.