03 · What You Need to Know
Calculating and Justifying Sample Size for Mean Estimation
What Exactly Are You Trying to Estimate?
A population mean is the arithmetic average of a numerical characteristic across the population of interest. It is commonly represented by μ.
For example, μ might represent the average achievement score of all eligible students enrolled in a particular university during an academic term.
The sample mean, usually represented by x̄, is calculated from the observed sample and used to estimate μ.
Before calculating sample size, define the population, the outcome variable, its measurement units, and the intended sampling process. An estimate of average examination performance among all enrolled students is not necessarily the same estimand as an average among students who voluntarily complete an online survey.
The formula for a single population mean also differs from the formula for comparing two independent means or estimating a mean paired difference. Those designs require their own variance structures.
What Is the Basic Sample-Size Formula?
Under independent sampling from a sufficiently large population, with an assumed population standard deviation and a suitable normal approximation, the standard error of the sample mean is σ/√n.
For a two-sided confidence interval, the approximate half-width is Zσ/√n. Rearranging this expression produces the conventional sample-size formula.
Always round a fractional sample-size requirement upward. Rounding downward can produce a sample smaller than the calculated requirement.
The formula also assumes that the sample mean and its standard error are appropriate for the population and sampling process. It does not correct nonrepresentative sampling or systematic measurement error.
How Do You Choose the Confidence Level?
The confidence level determines the critical value used in the calculation. Common two-sided normal critical values are approximately 1.645 for 90% confidence, 1.960 for 95%, and 2.576 for 99%.
A higher confidence level requires a larger sample to maintain the same target margin of error, with all other assumptions unchanged.
For example, increasing the confidence level from 95% to 99% increases the required sample under the normal approximation by a factor of approximately (2.576/1.960)2, or 1.73.
Confidence levels should be chosen according to the research purpose and relevant methodological requirements, rather than adjusted solely to obtain a more convenient sample size.
How Should You Determine the Margin of Error?
The margin of error is the maximum approximate distance from the sample estimate to either confidence limit under the planned symmetric interval.
For example, a target margin of error of three examination points corresponds to an anticipated total interval width of six points.
The target should reflect what researchers need to distinguish. An interval spanning six points may be acceptable for broad institutional monitoring but inadequate when decisions depend on differences of only one or two points.
There is no universally appropriate margin of error for estimating a mean. The choice should be justified in the outcome's original units whenever possible.
The broader question of how narrow a confidence interval should be depends on the intended scientific interpretation and practical consequences.
How Does the Standard Deviation Affect Sample Size?
The population standard deviation describes how dispersed individual outcome values are around the population mean.
Greater variability generally requires more observations to estimate the mean with the same absolute precision.
Under the conventional formula, sample size is proportional to the square of the standard deviation. Doubling the assumed standard deviation therefore quadruples the initial required sample size when the confidence level and margin of error remain fixed.
For example, at 95% confidence and a target half-width of three points, σ = 10 produces an initial requirement of approximately 43 observations, while σ = 20 produces approximately 171.
The standard deviation should be estimated from credible evidence rather than selected arbitrarily.
What If the Population Standard Deviation Is Unknown?
In most practical studies, the true population standard deviation is not known before data collection.
Researchers may use a relevant previous study, an existing dataset, a pilot investigation, or a defensible range of plausible values to inform planning.
However, a pilot standard deviation is itself an estimate. Small pilots may yield substantial uncertainty, and a borrowed estimate may not transfer directly to the proposed population.
When outcome variability is unknown, examine how the required sample changes across credible standard deviations rather than treating one uncertain value as exact.
The final analysis will commonly use a t-based confidence interval when the standard deviation is estimated from the data and the relevant assumptions are appropriate.
Should You Use a t Critical Value Instead of Z?
When estimating a population mean using a sample standard deviation, the conventional t interval has a half-width of t1−α/2,n−1s/√n under independent normal sampling.
Because the t critical value depends on the sample size, a t-based planning calculation can be solved iteratively using an assumed standard deviation.
One approach is to find the smallest integer n satisfying the following approximate planning condition:
For large samples, t and normal critical values become similar. For smaller samples, the difference may be consequential.
The usual t interval also relies on distributional assumptions, especially at small sample sizes. Strong skewness, influential observations, or heavy tails may require a different estimation strategy.
How Does the Target Margin of Error Change the Required Sample?
Because E appears in the denominator as E2, sample size increases rapidly as the target margin becomes smaller.
For a 95% normal-approximation calculation with σ = 12, the following requirements illustrate the relationship:
| Target half-width |
Target total width |
Approximate required sample |
| ±4 points |
8 points |
35 |
| ±3 points |
6 points |
62 |
| ±2 points |
4 points |
139 |
| ±1 point |
2 points |
554 |
These values are normal-approximation results rounded upward. They illustrate why a very narrow interval can require a substantially larger sample.
Researchers should select the target precision according to the information needed, not simply pursue the narrowest possible interval.
What If the Population Is Small and Finite?
When sampling without replacement from a known finite population, the sampling variance of the mean includes a finite population correction.
For simple random sampling without replacement, an approximate adjustment to the initial sample-size requirement is:
The finite population correction becomes more consequential as the sampling fraction increases. When the population is very large relative to the sample, its effect may be negligible.
What If Participants Are Clustered or Sampled Unequally?
The simple formula assumes independent observations under an appropriate sampling model. That assumption may not hold when participants are recruited through classrooms, schools, clinics, or other clusters.
Observations within the same cluster may be correlated, reducing the effective information contributed by a given number of participants.
Unequal selection probabilities, survey weights, stratification, and unequal cluster sizes can also affect the variance of the estimated mean.
Researchers should use a design-based or model-based sample-size calculation corresponding to the intended analysis. Multiplying the simple-random-sampling requirement by an assumed design effect can sometimes provide a useful approximation, but it is not universally sufficient.
The number of clusters may matter as much as the total number of individual observations.
How Should Nonresponse and Unusable Data Be Handled?
The calculated sample size generally represents the number of usable observations required for the intended analysis.
If only a proportion r of approached eligible individuals is expected to provide usable data, a simple recruitment target is the required completed sample divided by r, rounded upward.
For example, if 100 usable observations are required and the anticipated usable-response rate is 80%, approximately 125 eligible individuals must be approached.
However, additional recruitment does not automatically correct nonresponse bias. If participants who respond differ systematically from those who do not, the resulting mean may be biased even when the completed sample is large.
Does the Formula Guarantee the Planned Confidence Interval Width?
No. The conventional formula uses an assumed standard deviation and a normal approximation to determine a target sample size.
When the final interval uses the observed sample standard deviation, its width is random. Even if the assumed population standard deviation is correct, some realized intervals will be wider than the planning target.
Researchers who require a specified probability of achieving a maximum interval width need an appropriate assurance or probability-of-width calculation.
The distinction between expected precision and assured precision should be made explicit when the interval width is itself a consequential study requirement.
When Should You Use Precision Rather Than Statistical Power?
Estimating one population mean is usually an estimation problem. A precision-based calculation therefore often provides a more direct justification than testing whether the mean differs from an arbitrary null value.
However, if the primary objective is to determine whether the mean exceeds a prespecified threshold, a hypothesis-testing calculation may be appropriate.
The choice between precision-based and power-based sample-size planning should follow the intended inference.
When assumptions are uncertain, a sample-size sensitivity analysis can show how the required sample changes across plausible standard deviations or precision targets.