03 · What You Need to Know
How to Choose Among Different Levels of Analysis
Why Does the Choice of Analytical Unit Change the Research Question?
Every analytical unit defines a particular level of variation. Individuals differ from other individuals, households differ from other households, and institutions differ from other institutions.
A relationship estimated at one level does not necessarily describe the relationship at another.
For example, a positive association between average household income and average educational attainment across communities does not establish that higher-income individuals have greater attainment within every community.
Similarly, a relationship between individual teacher characteristics and classroom outcomes may differ from a relationship between school-level staffing characteristics and school performance.
Before selecting a unit, establish what the unit of analysis means for your intended inference. The choice should follow the scientific question rather than the structure of the available database.
When Should You Use Individuals as the Unit of Analysis?
Individual-level analysis is appropriate when the research question concerns characteristics, experiences, behaviors, outcomes, or relationships involving individual people.
Examples include whether student motivation is associated with academic performance, whether patient characteristics predict treatment outcomes, or whether employees' perceived organizational support relates to job satisfaction.
The individual is the analytical case, even when information about that individual comes from several sources or repeated measurements.
Individual-level analysis is particularly useful when researchers need to examine variation within groups or adjust for personal characteristics.
However, individuals may share classrooms, hospitals, households, or organizations. Their observations may therefore be statistically dependent.
An individual-level research question does not justify ignoring the groups within which individuals are situated.
When Is the Household the Appropriate Unit?
Household-level analysis is appropriate when the phenomenon concerns resources, decisions, conditions, or outcomes meaningfully defined for a household rather than solely for its individual members.
Examples include household educational expenditure, access to electricity, housing conditions, food security, and shared internet connectivity.
Suppose researchers investigate whether household income is associated with the proportion of household expenditure allocated to education. Each household contributes a set of financial characteristics, making households the relevant analytical units.
However, household membership does not mean that every individual experiences household resources equally. Shared internet access, for example, may coexist with substantial differences in device availability, study space, and actual usage among household members.
Researchers should therefore distinguish household-level resource availability from individual-level access or experience.
If the question concerns how household conditions influence individual student achievement, a multilevel or otherwise appropriately structured individual-level analysis may be more suitable.
When Should You Analyze Classrooms?
Classrooms are appropriate analytical units when the research question concerns classroom-level characteristics, practices, environments, or outcomes.
Examples include comparing classroom instructional climate, average engagement, technology integration, or collective learning outcomes.
A classroom-level study might investigate whether classrooms with more frequent collaborative learning activities have higher average achievement.
Student-level observations may be aggregated to construct classroom measures, but the resulting analytical cases are classrooms.
Researchers should justify whether aggregation produces a meaningful classroom construct. A high average engagement score does not necessarily imply that students share similar experiences.
Classroom size, within-classroom variation, and the reliability of aggregated measures may affect the quality of classroom comparisons.
When the research question concerns individual students while accounting for classroom conditions, the appropriate approach may instead involve individual outcomes nested within classrooms.
When Is a Hospital the Unit of Analysis?
Hospital-level analysis is appropriate when the study concerns institutional characteristics or performance indicators defined at the hospital level.
Examples include relationships between hospital staffing ratios and institutional readmission rates, differences in patient safety systems, or variation in hospital-level service capacity.
Each hospital contributes an institutional observation, even when its indicators are calculated using records from thousands of patients.
Hospital-level analysis may be valuable for health systems research and organizational evaluation. However, differences between hospitals may reflect patient case mix, referral patterns, resource availability, and other contextual characteristics.
Researchers should consider whether risk adjustment is needed when comparing hospital outcomes.
Hospital-level associations should not automatically be interpreted as patient-level effects. For example, hospitals with higher staffing levels and lower mortality rates do not, by that association alone, establish the causal effect of staffing on an individual patient's mortality risk.
When Should You Use Organizations as the Unit of Analysis?
Organizational analysis is appropriate when the research question concerns properties, decisions, structures, or outcomes of organizations.
Organizations might include universities, companies, research institutes, government agencies, nonprofit institutions, or professional associations.
Examples include examining whether universities with larger research budgets produce more publications, whether organizations with formal AI governance policies differ in adoption practices, or whether institutional leadership structures relate to organizational performance.
Some organizational variables can be obtained directly from institutional records. Others may be constructed from employee surveys, administrative information, or observations of organizational practices.
Researchers should avoid treating one respondent's opinion as an unquestionable measure of an entire organization's characteristics.
When organizational constructs are measured through multiple respondents, aggregation procedures and evidence of within-organization agreement may be relevant.
When Is a Community the Appropriate Unit?
Community-level analysis is appropriate when the research question concerns geographically or socially defined groups and characteristics operating at that collective level.
Examples include relationships between community infrastructure and local educational participation, neighborhood socioeconomic conditions and service availability, or community-level health resources and population outcomes.
The definition of a community must be explicit. Administrative districts, neighborhoods, villages, and socially defined communities do not necessarily have equivalent boundaries or meanings.
Researchers should also consider whether the chosen geographic boundaries correspond to the processes under investigation.
For example, students may attend schools outside their residential communities, and patients may obtain healthcare outside their administrative districts.
Community-level analysis can reveal contextual patterns, but it may obscure differences among individuals living within the same community.
When Should You Use Countries as the Unit of Analysis?
Country-level analysis is appropriate when the research question concerns national characteristics, policies, institutions, or aggregate outcomes.
Examples include relationships between national education expenditure and aggregate learning indicators, differences in research investment across countries, or associations between national digital infrastructure and educational participation.
Country-level research often uses international databases and harmonized indicators.
However, countries differ in population size, institutional arrangements, data quality, and the definitions used to construct national statistics.
Comparability should therefore be evaluated before estimating cross-country relationships.
Country-level analyses are also vulnerable to ecological inference problems. A relationship between national averages does not establish the corresponding relationship among individuals within countries.
When observations span multiple years, researchers must also account for repeated measurements of the same countries and potentially shared regional or temporal influences.
How Do the Different Units Compare?
| Unit |
Best suited to |
Important limitation |
| Individual |
Personal characteristics, behaviors, experiences, and outcomes |
Shared contexts and clustering may affect inference. |
| Household |
Shared resources, expenditure, and household conditions |
Household averages may conceal unequal individual experiences. |
| Classroom |
Instructional environments and classroom-level outcomes |
Aggregation may conceal student variation. |
| Hospital |
Institutional healthcare performance and service capacity |
Patient case mix and institutional context affect comparisons. |
| Organization |
Organizational structures, policies, and performance |
Individual respondents may not represent organizational properties. |
| Community |
Local conditions, resources, and collective outcomes |
Geographic boundaries and within-community heterogeneity matter. |
| Country |
National policies, systems, and aggregate indicators |
Cross-national comparability and ecological inference require caution. |
The table identifies common applications, not rigid restrictions. A single study may involve several of these levels when the research question requires it.
What If Your Predictor and Outcome Exist at Different Levels?
A predictor may be defined at one level while the outcome is measured at another.
For example, classroom instructional climate is a group-level characteristic, while student achievement is an individual-level outcome.
Likewise, hospital staffing is an institutional characteristic, while recovery or mortality may be measured for individual patients.
These are cross-level relationships. They may be investigated using multilevel models or other analytical approaches that account for the structure of the data.
Researchers should identify the level of each variable, the level of the outcome, and the estimand being targeted.
A group-level predictor does not automatically make the group the only unit of analysis, just as individual-level outcomes do not eliminate the importance of group-level assignment or dependence.
Can Individual-Level Data Be Used to Construct Group-Level Measures?
Yes. Researchers frequently aggregate individual observations to construct household, classroom, organizational, or community measures.
For example, individual student engagement scores may be averaged to represent classroom engagement. Employee responses may be aggregated to estimate organizational climate.
However, aggregation requires conceptual and measurement justification.
Researchers should consider whether the construct genuinely exists at the group level, whether the selected respondents adequately represent the group, and whether the aggregate measure is sufficiently reliable.
The relationship between individual-level data and group-level analysis deserves attention because the resulting group measures may not preserve the relationships observed among individuals.
Why Can't Group-Level Findings Automatically Be Applied to Individuals?
Group-level relationships can differ substantially from individual-level relationships.
Suppose communities with higher average household income also have higher average student achievement. This does not establish that higher-income students achieve better results within each community.
The aggregate relationship may reflect school quality, infrastructure, demographic composition, or other contextual differences.
Drawing individual-level conclusions from aggregate associations without appropriate supporting information is an ecological inference error.
Researchers should be particularly careful when making individual-level claims from group-level data.
The reverse problem also exists: individual-level associations cannot automatically be generalized to relationships between groups.
How Does the Choice of Unit Affect Sampling?
The analytical unit influences what must be sampled and how much independent information the study can obtain.
If the research question concerns universities, recruiting many students from only two universities does not provide a large sample of universities.
Likewise, measuring hundreds of patients in a small number of hospitals does not create hundreds of independent hospital-level observations.
For group-level questions, the number and diversity of groups may be more consequential than the total number of individuals measured within them.
For individual-level questions, sampling individuals through groups may still be appropriate, but clustering should be accounted for in sample size planning and analysis.
The distinction between recruitment units and analytical units is especially important in multistage sampling and institution-based studies.
How Does the Unit Affect Statistical Independence?
Observations within the same household, classroom, hospital, or organization may be correlated because they share environmental or institutional influences.
For example, students in one classroom may experience the same teacher, timetable, instructional resources, and assessment practices.
Treating those students as independent observations without considering classroom clustering can produce misleading uncertainty estimates.
Researchers should evaluate when clustering must be accounted for in the research design.
Depending on the question and data structure, appropriate methods may include multilevel models, cluster-robust standard errors, generalized estimating equations, or analysis of suitably defined group-level summaries.
These methods have different assumptions and may estimate different quantities. The choice should not be based solely on software availability.
What If the Intervention Is Assigned at a Different Level?
Intervention studies introduce an additional distinction between the unit of assignment and the unit of outcome measurement.
For example, an instructional intervention may be assigned to classrooms while learning outcomes are measured for individual students.
The classroom is the unit of randomization, even though students provide the outcome measurements.
The number of independently assigned classrooms is central to the precision and credibility of the treatment comparison.
Analyzing students as though they were independently randomized can create pseudoreplication and misleading standard errors.
Researchers should therefore distinguish the unit of randomization from the unit of measurement before planning the intervention and analysis.
Can a Multilevel Design Be Better Than Choosing One Level?
Yes, when the research question genuinely involves processes operating at several levels.
Suppose researchers want to investigate whether individual students' digital literacy predicts achievement and whether this relationship varies according to classroom technology integration.
An individual-only model may overlook classroom context. A classroom-only model may discard meaningful individual variation.
A multilevel approach can represent individual outcomes and group-level characteristics within one analytical framework.
However, multilevel modeling is not automatically necessary whenever data are nested. The decision depends on the estimand, number of groups, correlation structure, and available information.
Complex models also require adequate data at the levels being estimated. Hundreds of students distributed across only a few classrooms may provide limited information about between-classroom relationships.
How Should You Report the Chosen Unit?
The methods section should identify the primary unit of analysis and explain why it corresponds to the research question.
Where applicable, report the number of individuals, households, classrooms, institutions, or other groups represented.
Distinguish the units selected during sampling from the units observed, assigned to intervention conditions, and analyzed.
For multilevel studies, specify the levels of the outcome and predictors, the nesting structure, and how statistical dependence was handled.
This makes the scope of inference clear and allows readers to assess whether the analytical method matches the design.