03 · What You Need to Know
How to Identify Stratification Variables That Actually Improve Your Sample
Start with the Purpose of Stratification
Stratification is not simply the practice of categorizing participants. It is a probability sampling procedure in which a population is divided into strata before separate probability samples are selected within them.
The first question is what stratification is expected to accomplish.
One purpose is to support estimation for specific population groups. A national study may require separate estimates for geographical regions, institutional sectors, or school levels. Stratifying by these characteristics can help researchers allocate sufficient observations to each reporting domain.
Another purpose is to improve precision for overall population estimates. When strata distinguish units with meaningfully different outcome distributions, sampling separately within them may reduce variance compared with unrestricted random sampling.
A third purpose may be operational. Different institutions or geographical areas may require separate sampling arrangements, fieldwork teams, or recruitment procedures.
These purposes should be distinguished because they can lead to different choices of stratification variables and sample allocation.
Which Characteristics Make Good Stratification Variables?
A useful stratification variable should satisfy several methodological conditions.
It must be available before selection. Researchers need to classify eligible population units into strata before drawing the sample. A characteristic measured only after participants complete the survey generally cannot be used for conventional preselection stratification unless suitable frame information already exists.
It must be sufficiently accurate. If institutional sector, school level, or geographical assignment is incorrectly recorded, the sampling procedure may place units in the wrong strata.
It should serve a research objective. The variable should support required subgroup estimates, predict relevant outcome variation, or address a genuine operational requirement.
It must permit a workable partition. For conventional mutually exclusive stratification, each eligible unit should be assigned to exactly one stratum, and the combined strata should cover the target population.
For example, a school registry may reliably identify whether each institution belongs to the public or private sector. That characteristic could be appropriate if the study requires sector comparisons or if school sector is expected to explain meaningful differences in the outcome.
By contrast, an unreliable classification based on outdated institutional records may undermine the intended benefits of stratification.
How Does Within-Stratum Homogeneity Improve Precision?
For many stratified estimators, precision improves when units within each stratum are relatively similar on the outcome of interest, while meaningful differences exist between strata.
Consider a study estimating average weekly internet usage among students. Suppose students in different academic programs have substantially different average usage patterns, but usage is relatively consistent within each program.
Stratifying by academic program may reduce sampling variance because each program is represented through a separate probability sample.
The benefit depends on how the sample is allocated and how strongly the stratification variable is associated with the outcome. If academic program has little relationship with internet usage, the precision gain may be negligible.
For a stratified mean estimated using independent simple random samples without replacement, the design variance can be expressed as:
Researchers should use prior data, administrative information, or defensible pilot estimates to evaluate the likely relationship between candidate stratification variables and important outcomes.
When several outcomes are equally important, a variable that improves precision for one may provide little benefit for another. The choice should reflect the study's actual estimation priorities.
Is Improving Representativeness the Same as Improving Precision?
Not exactly. The term representativeness is often used loosely to describe how closely a sample resembles its population. In probability sampling, it is more useful to distinguish population coverage, controlled subgroup allocation, and the statistical precision of estimators.
Stratification can ensure that specified population groups contribute observations to the selected sample, provided the design allocates a positive sample size to each relevant stratum.
However, obtaining observations from every stratum does not guarantee that respondents accurately reflect all characteristics of their respective populations.
Similarly, a sample that reproduces the population's proportions across a few demographic variables may still differ on other characteristics or suffer from nonresponse bias.
Subgroup coverage
Ensuring that specified population groups are included in the sampling design with adequate planned observations.
Statistical precision
Reducing the sampling variability of estimates across repeated applications of the design.
A stratification variable may be valuable for subgroup coverage even if it provides little improvement in overall precision. Conversely, a variable that strongly predicts an outcome may improve precision without corresponding to a group that requires separate reporting.
Should Strata Be Based on Demographics, Geography, or Institutional Characteristics?
There is no universally preferred category of stratification variables.
Demographic characteristics may be appropriate when population-level information is reliable and the study requires estimates for defined demographic groups.
Geographical variables may be useful when regional estimates are required, fieldwork differs by location, or outcomes are expected to vary geographically.
Institutional characteristics such as school sector, school size, academic program, or organizational type may be useful when these variables are related to the research question.
The choice should follow substantive knowledge of the population rather than a routine practice of stratifying by age, sex, or location regardless of relevance.
For instance, school size might be a useful stratification variable in a study of institutional technology infrastructure, while teaching assignment could be more informative for a study of discipline-specific AI adoption.
Can You Stratify Using More Than One Variable?
Yes. Researchers can define strata using combinations of variables, often called cross-classified strata.
A study might stratify schools by geographical region and institutional sector. If there are four regions and two sectors, the complete cross-classification produces up to eight strata.
This approach can support deliberate sampling across both characteristics, but the number of strata can increase rapidly.
For example, combining five regions, three school levels, and two institutional sectors could produce as many as 30 strata. Some combinations may contain very few eligible units or no units at all.
Small strata can create allocation difficulties, increase operational complexity, and limit within-stratum variance estimation.
Researchers may need to combine categories, prioritize the most consequential variables, or use implicit stratification through appropriate frame ordering rather than crossing every available characteristic.
The objective is not to maximize the number of strata. It is to define a manageable partition that supports the required inference.
What Happens When Some Strata Are Very Small?
Small strata require particular attention because proportional allocation may produce too few observations for separate estimation.
Suppose a population group represents 2% of the target population. In a proportional sample of 500, that group would receive approximately 10 selected units.
Ten observations may be insufficient for precise subgroup estimates or planned comparisons.
One option is oversampling the small group, provided the resulting unequal selection probabilities are handled appropriately.
Another possibility is to combine small strata when doing so is substantively defensible and does not undermine essential subgroup reporting.
Some strata may be selected with certainty when their entire population is small enough to enumerate. This requires explicit treatment in the design and analysis.
Small population groups should not automatically be removed simply because they complicate allocation. Their importance depends on the research question and intended population claims.
How Does Sample Allocation Interact with the Choice of Strata?
Stratification variables and sample allocation should be planned together.
Under proportional allocation, each stratum receives a sample approximately proportional to its population size. Under disproportionate allocation, sample sizes may reflect subgroup precision requirements, outcome variability, or fieldwork costs.
For estimating an overall mean under independent simple random sampling within strata, Neyman allocation assigns sample sizes approximately in proportion to stratum population size multiplied by within-stratum standard deviation, when per-unit costs are equal and the relevant assumptions apply.
That approach can improve precision for a particular outcome, but it may not be optimal for every subgroup estimate or every research objective.
The distinction between proportional and disproportionate allocation is therefore consequential when choosing strata.
Where selection probabilities differ across strata, sampling weights generally need to reflect those differences for population-level estimation.
When Is a Stratification Variable Not Worth Using?
A candidate variable may be unnecessary when it contributes little to the required subgroup estimates, has weak relationships with important outcomes, or cannot be measured reliably in the frame.
Stratification may also be inefficient when it creates many small categories requiring extensive administrative work without meaningful gains in precision.
If no available variable offers a clear benefit and the population can be sampled directly, simple random sampling may be sufficient.
Where an ordered frame is available, systematic sampling with an appropriate ordering may offer some of the practical advantages of spreading observations across a population characteristic, although its statistical properties differ from explicit stratification.
Researchers should select strata because they improve the design's fitness for purpose, not because stratification is assumed to be inherently superior.
04 · A Practical Example
Choosing Strata for a Study of Teachers' Digital Competence
Hypothetical Example
Comparing Candidate Stratification Variables
A researcher wants to estimate average digital competence among 8,000 teachers across a region. The study also requires separate estimates for public- and private-school teachers.
The available teacher registry contains school sector, geographical region, school level, and years of teaching experience.
The researcher must decide which variables should define the sampling strata.
The researcher first considers the required subgroup estimates. Because the study explicitly compares public- and private-school teachers, school sector is a strong candidate for stratification.
Geographical region is also considered because prior administrative information suggests differences in technology access between regions. However, the study does not require a separate estimate for every region.
Years of teaching experience is available, but the researcher has limited evidence that it strongly predicts the primary outcome. Stratifying by several experience categories would also substantially increase the number of strata.
| Candidate variable |
Potential benefit |
Decision |
| School sector |
Directly supports required public-private comparisons |
Use as an explicit stratification variable |
| Geographical region |
May improve coverage and precision where technology access differs |
Evaluate cross-classification or ordering within sectors |
| School level |
May be associated with digital competence and instructional demands |
Use only if evidence or reporting needs justify it |
| Teaching experience |
Potentially related to the outcome but with uncertain predictive value |
Do not automatically create additional strata |
The researcher chooses school sector as the primary stratification variable. Regional information is retained for evaluating sample distribution and possible precision improvements.
If reliable preliminary data show that region is strongly associated with digital competence, the researcher may consider combining sector and region into a manageable set of strata.
However, if some sector-by-region combinations contain very few teachers, a simpler design may be preferable.
The final decision is documented in relation to the required subgroup comparisons, available population information, expected precision, and feasible sample allocation.
This approach avoids treating every available demographic or institutional characteristic as an automatic reason for stratification.