03 · What You Need to Know
Understanding Where Surveys Fit Within Research Methodology
Why Is the Term "Survey" Used in More Than One Way?
Methodological terminology does not follow a single classification system shared by every discipline or research tradition.
In survey methodology, a survey may refer to an organized investigation involving a target population, sampling procedures, standardized measurement, data collection, estimation, and analysis. Under this usage, the survey is more than the questionnaire administered to respondents.
In other research traditions, especially when researchers distinguish research design from individual data-collection techniques, a survey may be identified as a method used within a broader design.
Neither usage is automatically incorrect. The problem arises when researchers use the term without explaining what it means in their particular study.
For example, the statement "This study used a survey" does not establish whether participants were selected through probability sampling, whether responses were collected once or repeatedly, whether the analysis was descriptive or explanatory, or whether the survey was one component of a larger investigation.
Those details are necessary to understand what the study actually did and what conclusions it can support.
Research Design Refers to the Logic of the Investigation
A research design specifies how a study is organized to address its research questions and support its intended inferences.
It concerns decisions such as:
- What phenomenon, population, or relationship is being investigated?
- What evidence is required to answer the research question?
- How will participants, cases, settings, or observations be selected?
- When and how often will measurements occur?
- Will the study involve an intervention, comparison group, or naturally occurring variation?
- How will the resulting evidence be analyzed and interpreted?
Different methodological frameworks emphasize different dimensions of design. Some classify studies by purpose, such as descriptive or explanatory research. Others emphasize timing, manipulation, comparison structures, or qualitative traditions.
These classifications may overlap because they answer different questions about a study.
Consequently, identifying a study as a survey does not necessarily provide a complete description of its design.
Survey Research Can Be a Broader Methodological Strategy
When researchers use the expression "survey research," they commonly refer to systematic investigation through information collected from respondents, often with the intention of describing a population or examining relationships among variables.
In this sense, survey research includes decisions about population definition, sampling, questionnaire construction, administration, data quality, and analysis.
A population-based survey designed to estimate the prevalence of particular attitudes illustrates this broader usage. The researcher is not merely distributing questions. The entire investigation is structured around obtaining and interpreting survey evidence.
Calling such an investigation a survey research design may be reasonable within a methodological framework that recognizes survey research as a design or strategy.
However, the description should still specify the characteristics that affect interpretation, such as whether the survey is cross-sectional or longitudinal and whether its sampling approach supports population inference.
Survey Data Collection Can Occur Within Other Research Designs
A survey instrument may also serve as one source of evidence within a design whose defining features are not determined by survey methodology.
Consider an experiment evaluating an educational intervention. Participants might be randomly assigned to instructional conditions, complete a knowledge assessment, and respond to a satisfaction questionnaire.
The study's experimental design is established by the allocation and comparison procedures, not by the presence of a questionnaire. The questionnaire measures an outcome or supplementary variable within that design.
Similarly, a qualitative case study may include a questionnaire to gather background information about participants. That questionnaire does not necessarily transform the entire study into survey research.
In a mixed-methods study, survey data may be integrated with interviews or observations. The overall design must explain the relationship between these forms of evidence rather than relying on the word "survey" to describe the whole investigation.
A Questionnaire Is an Instrument, Not Automatically a Research Design
One of the most useful distinctions is between a survey and a questionnaire.
A questionnaire is an instrument containing questions or items used to obtain responses. It may include fixed-response items, open-ended prompts, rating scales, or other structured measures.
A survey, when used in its broader methodological sense, encompasses the procedures through which information is collected and interpreted, including the population, sampling, administration, and data-quality considerations.
Research design
The overall logic and organization through which a study seeks to answer its research questions.
Survey research strategy
A broader investigation organized around systematically collecting and analyzing information from respondents.
Survey data-collection method
The procedure of obtaining information from respondents through standardized questions or structured requests.
Questionnaire
The instrument containing the questions or items administered to respondents.
These categories are analytically useful, but they should not be treated as a universally accepted hierarchy. Some methodological texts organize their terminology differently.
Cross-Sectional and Longitudinal Describe the Timing of Survey Measurement
A common source of confusion is the relationship between survey research and temporal design.
A cross-sectional survey collects information about a population during a defined period without prospectively following the same individuals across multiple measurement occasions.
A longitudinal survey involves repeated measurements over time. Some longitudinal surveys follow the same respondents, while others collect repeated samples from the same population.
These distinctions describe how survey observations are organized over time. They do not, by themselves, specify every aspect of sampling, measurement, or analysis.
The choice between cross-sectional and longitudinal survey approaches should therefore follow the temporal demands of the research question.
Descriptive, Correlational, and Explanatory Labels Describe Different Features
Researchers sometimes describe a study as a "descriptive survey," "correlational survey," or "descriptive-correlational survey."
Such terminology can communicate the purpose of the investigation, but it should be used carefully.
A descriptive study may estimate the frequency or distribution of characteristics within a population. A correlational investigation examines statistical associations among variables. An explanatory study seeks to account for patterns or relationships, although the strength of its explanations depends on the design and evidence.
These objectives can be pursued using survey data, but they are not interchangeable with the method of collecting those data.
For example, describing a study as "descriptive-correlational" does not reveal whether participants were randomly sampled, whether measures were valid, or whether observations were collected at one time point.
Methodological precision requires reporting these features rather than expecting a single compound label to convey them.
Online, Telephone, Paper, and Interviewer-Administered Describe Survey Modes
Another distinction concerns how respondents receive and answer survey questions.
An online survey is not a separate research design simply because it is administered through a digital platform. Online administration describes the mode of data collection.
The same applies to paper questionnaires, telephone surveys, face-to-face interviewer-administered surveys, and combinations of administration modes.
Administration modes matter methodologically because they can influence coverage, participation, privacy, question comprehension, and response patterns.
However, they do not automatically determine whether a study is descriptive, longitudinal, experimental, or qualitative.
The distinction among survey administration modes should be reported separately from the overall research design.
Sampling Is Another Dimension That Should Be Specified Separately
Survey research frequently aims to describe or make inferences about a defined population. For that reason, sampling decisions are central to the credibility of many survey findings.
A probability sample uses a selection process in which eligible units have known, nonzero selection probabilities, subject to the particular sampling design. A nonprobability sample does not provide the same design-based basis for population inference.
These sampling approaches can both involve questionnaires. Their inferential implications are nevertheless different.
Likewise, a census survey and a sample survey differ in whether the researcher attempts to include every eligible population unit or selects a subset.
Neither sampling label substitutes for describing the overall research design.
What Does It Mean to Call a Study a Quantitative Survey?
The expression "quantitative survey research" generally indicates that responses are collected and analyzed in numerical or categorically coded forms to describe patterns, estimate quantities, or examine relationships.
It is a useful description when the study genuinely follows that approach.
However, a questionnaire containing open-ended questions does not automatically establish a qualitative research design. Nor does adding a few open-ended items automatically make a study mixed methods.
The classification should reflect the research questions, the nature of the evidence, the analytical procedures, and the intended integration of findings.
A study using numerical survey results and systematically analyzed interview accounts may employ a mixed-methods design if the two forms of evidence are meaningfully integrated. Merely collecting both types of responses is not sufficient to explain the design.
How Should You Describe Survey Research in a Methodology Chapter?
Rather than choosing between "survey design" and "survey method" as if only one expression were permissible, describe the methodological decisions at the appropriate levels.
A complete description might identify:
- The overall research approach and design.
- The purpose of the investigation.
- The temporal structure of measurement.
- The target population and sampling strategy.
- The role of the survey within the study.
- The questionnaire or other survey instrument.
- The administration mode and data-collection procedures.
- The analytical procedures and relevant limitations.
For example, "The study employed a cross-sectional survey design to examine the association between perceived instructional support and student engagement" is more informative than "The study used a survey design."
Alternatively, "The study employed a randomized experimental design and used a self-administered questionnaire to measure participant satisfaction" correctly places the questionnaire within the broader experiment.
These descriptions communicate what the researcher did without requiring a rigid universal classification of the term "survey."