03 · What You Need to Know
How to Determine Whether an Existing Registry or Cohort Is Suitable
What Is the Difference Between a Registry and a Cohort?
A registry is an organized system that collects defined information about individuals, conditions, procedures, services, or outcomes for specified purposes. Registries may support clinical care, surveillance, quality improvement, administration, or research.
A cohort is a group of individuals defined by shared characteristics, eligibility criteria, exposures, or membership at a particular point or period. Cohort studies examine these individuals over time to investigate outcomes, associations, or changes.
The distinction matters because a registry describes a data collection infrastructure, whereas a cohort describes a population grouping that may be studied longitudinally. A registry can provide the data needed to construct a cohort, and an established cohort may itself maintain a structured data repository.
| Consideration |
Existing Registry |
Existing Cohort |
| Original purpose |
Often established for surveillance, service monitoring, quality improvement, or research |
Often assembled to observe a defined group and investigate outcomes over time |
| Population entry |
May involve continuous enrollment or recording of eligible events |
May involve enrollment at baseline, with or without subsequent recruitment waves |
| Measurements |
May reflect routine practice or standardized registry protocols |
May follow a research-specific measurement schedule |
| Follow-up |
May be continuous, event-driven, irregular, or absent |
May involve planned follow-up waves, record linkage, or passive outcome ascertainment |
| Typical limitation |
Incomplete coverage, inconsistent recording, or variables collected for nonresearch purposes |
Attrition, cohort aging, historical measurement choices, or limited generalizability |
These are tendencies rather than universal distinctions. Some registries have rigorous longitudinal follow-up, while some cohorts are assembled retrospectively from routinely collected records.
Start With the Research Question, Not the Available Variables
One of the most consequential decisions occurs before opening the dataset: determining what evidence would be necessary to answer the question independently of what happens to be available.
Suppose you want to examine whether participation in an online academic support program is associated with subsequent student retention. The necessary evidence may include program participation dates, retention outcomes, relevant baseline characteristics, and the timing of enrollment or withdrawal.
An institutional registry containing only current enrollment status and cumulative program participation cannot necessarily establish whether participation preceded the retention outcome. A large number of records does not resolve this temporal ambiguity.
Begin by specifying the population, exposure or predictor, outcome, relevant time period, and intended inference. Only then should you determine whether an existing registry or cohort provides the necessary information.
Does the Existing Population Match the Population You Want to Study?
Existing datasets rarely include everyone who could belong to the target population. Their coverage is shaped by recruitment practices, participating institutions, eligibility requirements, service utilization, and the circumstances under which records were created.
A specialist hospital registry, for example, may contain patients with more complex conditions than those treated in community settings. An educational cohort recruited from one university may differ from students enrolled in other institutional types.
You should therefore evaluate the alignment between the registry population and your intended target population before assuming that findings will apply beyond the recorded participants.
Population mismatch does not automatically invalidate a study. It may instead require a narrower research question, a clearly defined analytic population, or explicit limits on generalizability.
Are the Required Variables Actually Available and Adequately Measured?
Variable availability involves more than finding a column with a familiar name.
Researchers need to establish what each variable represents, how it was measured, when it was recorded, and whether its operational definition corresponds to the intended construct.
For example, a registry field labeled "treatment adherence" might represent prescription refills rather than actual medication consumption. A university database field labeled "engagement" might reflect learning management system logins rather than meaningful participation in learning activities.
Both variables may be useful, but neither should be interpreted as a broader construct without appropriate justification.
Inspect the data dictionary, collection instruments, coding rules, measurement protocols, and documentation of changes. If essential variables are absent or poorly measured, the dataset may be unsuitable even when other information is extensive.
Does the Dataset Capture the Necessary Time Sequence?
Some questions require only a defined observation at one point in time. Others depend on identifying what happened before, during, and after an exposure or intervention.
For longitudinal or causal questions, examine whether the data establish meaningful time ordering. Relevant considerations include baseline measurement, exposure onset, outcome ascertainment, follow-up duration, and whether individuals enter observation at different times.
Historical registry records may support a retrospective cohort analysis when exposure and subsequent outcome information can be reconstructed appropriately.
However, the mere existence of historical records does not establish that a retrospective cohort design is possible. Dates may be missing, events may have occurred before observation began, or outcomes may have been recorded selectively.
Researchers should also consider whether the analysis is vulnerable to immortal time bias, left truncation, informative censoring, or differential follow-up. The relevance of each problem depends on the study design.
How Complete, Accurate, and Consistent Are the Records?
Data quality should be evaluated in relation to the intended analysis rather than described only through an overall completeness percentage.
Important dimensions include missingness, accuracy, internal consistency, duplicate records, measurement validity, temporal consistency, and the ability to link repeated observations to the correct individuals.
Missing data deserve particular attention. If missingness is associated with participant characteristics, exposure, or outcomes, a complete-case analysis may introduce bias. Statistical methods for handling missing data require assumptions that should be assessed and reported.
Similarly, definitions and recording procedures may change as registries evolve. Researchers examining long periods should investigate changes in registry definitions over time rather than treating every recorded value as directly comparable.
A useful feasibility assessment includes exploratory data checks, missingness summaries, codebook review, and discussions with data custodians or personnel familiar with the collection process.
Can the Registry Support the Research Design You Intend to Use?
An existing registry is a source of data, not a research design in itself.
Depending on its structure, it may support descriptive analyses, longitudinal analyses, retrospective cohorts, nested case-control studies, or repeated cross-sectional comparisons.
Each design imposes different requirements. A nested case-control study within a registry-defined cohort, for example, requires a defensible source cohort and an appropriate method for selecting controls from individuals at risk when cases occur.
By contrast, repeated cross-sectional analyses may be feasible when comparable population measurements exist across periods, even without complete individual follow-up.
Do not assign a design label solely because the records are historical or because multiple years appear in the dataset. Determine whether the available observations satisfy the actual design requirements.
Is the Dataset Current Enough for the Intended Claim?
Older data are not inherently inferior. Historical records may be particularly valuable for studying long-term outcomes, temporal patterns, or conditions that are no longer common.
Nevertheless, changes in technology, clinical practice, institutional policies, demographic composition, or social conditions can limit the relevance of historical observations to present-day populations.
The appropriate question is whether the relationship being studied is likely to remain meaningful under the conditions to which the findings will be applied.
For instance, a cohort assembled before widespread adoption of generative AI may still be useful for investigating historical educational technology adoption, but it may not adequately represent current AI-mediated learning practices.
Evaluate whether an existing cohort is too old for the intended research question in terms of substantive relevance, not merely the calendar year of data collection.
Could Participation, Survival, or Continued Follow-Up Introduce Bias?
Registry participation is not always random. Individuals who receive particular services, consent to research, remain enrolled, or continue attending follow-up appointments may differ systematically from those who do not.
These differences can affect descriptive estimates and associations. Their consequences depend on how participation or retention relates to the variables under investigation.
Researchers should examine systematic differences between registry participants and nonparticipants whenever information about the underlying eligible population is available.
Longitudinal datasets also require attention to survivorship and selection bias, particularly when analyses include only participants who remained observable or completed every follow-up wave.
Neither statistical adjustment nor a large sample automatically eliminates these concerns.
Do You Have Legitimate Access and Permission for the Proposed Use?
Access to records for employment, teaching, administration, or clinical care does not automatically authorize their use in research.
Before extracting data, determine the applicable ethical review requirements, data governance arrangements, privacy protections, consent restrictions, and institutional permissions.
Some projects may qualify for an exemption or waiver under applicable rules, but researchers should not make that determination informally when institutional review procedures require an authorized decision.
Data-sharing agreements may restrict linkage, redistribution, publication of small cells, international transfer, or attempts to reidentify participants.
These restrictions can affect the feasibility of the research question and the analysis itself. Clarify them before committing to the study.
When Is New Data Collection the Better Option?
New data collection may be preferable when the existing dataset lacks essential constructs, cannot establish the necessary time sequence, systematically excludes the population of interest, or contains measurement problems that cannot be adequately addressed.
It may also be necessary when the research question requires participant perspectives, contextual information, experimental manipulation, or measurements not captured by routine systems.
A hybrid approach is sometimes more efficient: existing records can supply baseline or historical information while new surveys, interviews, assessments, or follow-up measurements address critical gaps.
The choice should be based on scientific adequacy, feasibility, ethical considerations, and the limitations of each available option.