Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Do You Separate Numerical Results From the Authors’ Narrative?

The prose surrounding a statistical result can influence how strong, important, or certain it seems. Learn how to inspect the numbers first and then evaluate whether the authors’ narrative accurately represents them.

324
Separating Results From Narrative Guide 324 of 899
01 · The Question

Are you reading the result or the authors’ description of it?

Quantitative papers rarely present numbers without commentary. A difference may be described as “substantial,” an association as “strong,” a pattern as “promising,” or a non-significant result as evidence that groups did not differ.

Those words are not the numerical result itself. They are a narrative layer placed around it.

Critical reading therefore requires a small but consequential separation: first establish what the numerical analysis actually produced, then examine whether the language surrounding that result is proportionate to the evidence.

02 · The Short Answer

Extract the numbers before accepting the narrative

In Brief

Separate numerical results from the authors’ narrative by identifying the relevant raw or summary values, effect estimate, direction, uncertainty, sample size, and statistical analysis before considering descriptive words such as “large,” “important,” “effective,” “negligible,” or “meaningful.”

Then compare your numerical reconstruction with the authors’ wording. The narrative may accurately characterize the result, but its strength should come from the evidence rather than from persuasive phrasing.

03 · What You Need to Know

How to read quantitative findings underneath the prose

Find the estimate the sentence is describing

When an author makes a numerical claim, locate the statistic underneath it. Depending on the study, that might be a mean difference, risk ratio, odds ratio, correlation, regression coefficient, standardized effect size, hazard ratio, prevalence estimate, proportion, or another quantity.

For comparative studies, also identify the values being compared. A statement that one group “performed better,” for example, becomes more informative when you know that the groups averaged 82.1 and 80.9 on a 100-point scale.

The purpose is not to strip the study of context. It is to establish a numerical anchor against which the prose can be evaluated.

Ask how large the result actually is

A result can be statistically detectable without being large. Conversely, an estimated effect can be potentially important while remaining too imprecise for a confident conclusion.

This is why quantitative reporting standards emphasize effect estimates rather than relying only on significance tests. CONSORT 2025, for example, recommends reporting the result in each trial group together with the estimated effect size and its precision, such as a 95% confidence interval. APA reporting guidance likewise emphasizes effect sizes and confidence intervals alongside statistical significance.

So when a paper says an intervention “improved performance,” ask: improved by how much?

Read the confidence interval with the point estimate

A point estimate gives you one estimate from the observed data. It does not, by itself, communicate how precisely that quantity has been estimated.

A confidence interval helps represent that uncertainty under the statistical model and assumptions used. CONSORT 2025 recommends confidence intervals around estimated treatment effects and notes their value even when conventional statistical significance is not reached.

Suppose an estimated difference is 4.0 points. A confidence interval from 3.2 to 4.8 conveys a different degree of precision from an interval running from -1.5 to 9.5. The same point estimate sits at the center, but the evidence surrounding it is very different.

Do not translate p-values into effect magnitude

A small p-value does not mean the effect is large, important, or practically consequential. Likewise, a p-value above a conventional threshold does not establish that the effect is exactly zero.

The p-value addresses a statistical question under specified assumptions. It does not replace the effect estimate, its uncertainty, or substantive judgment.

This becomes particularly important when authors treat statistical significance as practical importance. A result can cross a significance threshold while remaining trivial for the decision the research is supposed to inform.

Check denominators and absolute quantities

Relative measures can sound dramatic when presented without absolute quantities.

Imagine an outcome occurring in 2 of every 1,000 participants in one group and 1 of every 1,000 in another. Depending on the effect measure, the relative difference can appear large, while the absolute difference is one event per 1,000 participants.

Neither representation is automatically the “correct” one. They answer different questions. For binary outcomes, CONSORT 2025 recommends reporting both absolute and relative effect sizes where appropriate because each contributes useful information.

Whenever percentages are reported, identify the denominator. “50% more” tells you much less than “an increase from 2% to 3%.”

Distinguish descriptive statistics from inferential estimates

Descriptive result Summarizes the observed sample, such as a mean, median, proportion, standard deviation, or frequency.
Inferential result Uses a statistical model or procedure to estimate, compare, test, or generalize beyond those observed values.

A difference between two sample means is not automatically the same quantity as an adjusted effect estimate from a regression model. Likewise, an observed percentage is not necessarily the same as a model-adjusted predicted probability.

When authors move between these quantities in prose, keep track of which number supports which statement.

Check whether the estimate is adjusted

Many papers report both unadjusted and adjusted results. An adjusted estimate is produced by a model that accounts for specified variables or features of the design.

Do not assume that “adjusted” automatically means “better” or “more correct.” The usefulness of an adjustment depends on why particular variables were included, how the model was specified, whether assumptions are reasonable, and the study design.

If the narrative emphasizes an adjusted estimate, identify what adjustment was made and whether that analysis was prespecified.

Separate primary results from favorable secondary findings

One of the most important narrative choices authors make is deciding which numbers receive attention.

A study may have a weak or inconclusive primary outcome while producing an apparently favorable secondary outcome or subgroup analysis. If the prose concentrates heavily on the favorable result, a casual reader may come away with a stronger impression than the primary analysis warrants.

Check which outcome was designated as primary, which analyses were prespecified, and whether the narrative has shifted attention toward a subgroup rather than the primary result.

Tables can reveal what the prose de-emphasizes

Numerical tables are especially useful because they often place several outcomes, groups, estimates, and intervals next to one another. CONSORT 2025 notes that trial results are often more clearly displayed in tables than in text.

Compare the prose with the table rather than reading either in isolation. Is the largest amount of narrative attention given to the primary outcome? Are null or unfavorable findings reported with comparable clarity? Are confidence intervals omitted from the prose even though they appear in the table?

This comparison helps you see not only what the study reported but also what the authors chose to foreground.

Adjectives are claims too

Words such as “strong,” “substantial,” “minimal,” “dramatic,” “meaningful,” and “negligible” contain judgments about magnitude or importance. They may be entirely reasonable, but they should not pass unnoticed simply because they are adjectives rather than statistical statements.

Try temporarily deleting the adjective.

“A substantial improvement of 2.1 points” becomes “an improvement of 2.1 points.” You can then ask whether 2.1 points is substantial on that measure, according to what criterion, and for which practical purpose.

Numerical results still require context

Numbers do not interpret themselves. An effect size depends on the measurement scale, research design, population, comparison, analytical assumptions, and substantive context.

Separating the number from the narrative is therefore an analytical step, not the final judgment. Once you know what the study actually found before interpretation, you can decide whether the authors’ description fairly represents it.

04 · A Practical Example

Compare the statistical result with the sentence built around it

Hypothetical Example

When “substantial improvement” needs a closer look

Suppose a study compares two teaching approaches using a 100-point achievement test. The authors write: “Students receiving the new approach demonstrated a substantial improvement in achievement compared with the control condition.”

Find the numbers Mean score: 82.3 in the intervention group and 80.1 in the control group.
Find the estimate Estimated between-group difference: 2.2 points.
Find the uncertainty 95% confidence interval: 0.5 to 3.9 points.
Remove the narrative The intervention group scored an estimated 2.2 points higher than the control group, with a 95% confidence interval from 0.5 to 3.9 points.
Evaluate the description Whether a 2.2-point difference is “substantial” cannot be established merely from its statistical detectability. You would need substantive information about the scale and what magnitude would matter educationally.

The neutral reconstruction does not prove that the authors’ adjective is wrong. It reveals what must be justified. Perhaps a two-point improvement has important consequences in this setting. If so, the paper should provide a defensible basis for that interpretation.

05 · What Researchers Often Get Wrong

Common mistakes when reading numerical findings

Misconception

If p <.05, the effect must be meaningful

Statistical significance does not establish the substantive size or importance of an effect. Examine the effect estimate, uncertainty, measurement scale, and practical context.

Misconception

If p >.05, the groups are the same

Failure to reject a null hypothesis is not generally evidence that the true effect is exactly zero. The estimate and its uncertainty may remain compatible with effects of practical interest. This is one reason to avoid turning “no evidence” into “no effect”.

Misconception

A percentage change tells the whole story

Relative changes can obscure the baseline rate and absolute difference. Whenever possible, inspect the underlying counts, denominators, or absolute risks as well as the relative measure.

Misconception

The number highlighted in the text must be the most important result

Narrative prominence and methodological priority are different things. Verify whether the highlighted result corresponds to the primary outcome or a secondary, exploratory, subgroup, or post hoc analysis.

Misconception

Numbers are objective, so they cannot be framed

The numerical outputs may be accurately calculated while their presentation remains selective. Authors choose which statistics to emphasize, which comparisons to describe, whether to foreground relative or absolute effects, and which findings receive space in the abstract and discussion.

06 · What This Means for You

Build a numerical summary before a verbal one

When a quantitative paper matters to your research, create a short numerical reconstruction of its central result before adopting the authors’ wording.

A simple reading framework

If the paper reports a difference
Record the values in each group, the estimated difference, and its uncertainty.
If the paper reports an association
Record the effect measure, direction, magnitude, confidence interval, and relevant adjustment variables.
If the paper emphasizes significance
Return to the effect estimate and ask how large and precise the result actually is.
If the wording sounds stronger than your numerical summary
Identify the exact interpretive step responsible for the difference before deciding whether it is justified.

You can then move from the numerical result to the broader question of what the data show versus what the authors conclude.

Watch Out

Do not replace one oversimplification with another by assuming the smallest-looking number is unimportant or the largest-looking number is important. Magnitude must be interpreted on the relevant scale and in the substantive context of the research question.

07 · A Quick Checklist

Check the numbers behind the narrative

When reading a quantitative claim, check:
Identify the exact numerical result supporting the claim.
Check the values or rates being compared and their denominators where relevant.
Record the direction and magnitude of the effect estimate.
Examine the confidence interval or other measure of uncertainty.
Distinguish unadjusted values from adjusted estimates.
Verify whether the result is primary, secondary, subgroup, exploratory, or post hoc.
Compare the prose with the corresponding table or figure.
Question evaluative adjectives until their substantive basis is clear.
08 · Frequently Asked Questions

Questions about reading numerical research results

Should I ignore the authors’ prose and read only the tables?

No. Tables and figures help you inspect numerical results, while the prose supplies context and explanation. The useful strategy is to compare them so that interpretation does not replace examination of the underlying numbers.

Which statistic should I look at first?

Start with the statistic that directly answers the primary research question. For a comparison, this will often include group values and an effect estimate with uncertainty. The appropriate statistic depends on the design and outcome.

Is a confidence interval more important than a p-value?

They provide different information, but an effect estimate with its confidence interval usually gives you information about magnitude and precision that a p-value alone cannot provide. Statistical interpretation should not be reduced to a single threshold.

Can authors accurately report every number but still create a misleading impression?

Potentially, yes. Selective emphasis, relative rather than absolute presentation, focus on favorable secondary analyses, or strong descriptive language can influence the overall impression even when individual numbers are technically accurate.

Does a large effect size automatically mean an important finding?

No. The meaning of an effect depends on the outcome, scale, population, study quality, uncertainty, and decision context. A large estimate can also be imprecise or affected by bias.

What if the numbers in the text and table do not match?

Do not silently choose one. Check whether they represent different analyses, populations, time points, adjustments, or measures. If they should represent the same result and remain inconsistent, treat the discrepancy as a reporting problem that may require clarification from supplementary materials, corrections, or the authors.

09 · The Bottom Line

Let the numbers constrain the story

The Bottom Line

To separate numerical results from the authors’ narrative, reconstruct the central result from the actual values, effect estimate, direction, uncertainty, and analytical context before accepting descriptive language about what the result means.

The authors’ narrative may ultimately be persuasive. Reading the numbers first simply gives you an independent reference point for judging whether that narrative is appropriately calibrated to the evidence.

10 · Sources and Further Reading

Sources and further reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes