Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Can a Technically Accurate Figure Still Misrepresent the Underlying Data?

A research figure can contain technically correct numbers and still give readers a distorted impression of the underlying data. Scale, aggregation, denominators, uncertainty, selection, and visual encoding all affect what a figure communicates.

463
Accurate but Misleading Figures Guide 463 of 530
01 · The Question

If Every Number in a Figure Is Correct, Can the Figure Still Be Misleading?

Imagine a graph in which every plotted value matches the dataset. Nothing has been fabricated. No point has been moved. No image has been digitally altered.

Yet the vertical axis begins just below the smallest value, making a modest difference look enormous. Or the figure shows only group means, hiding substantial overlap between individual observations. Perhaps percentages are compared without showing that the denominators differ dramatically.

The numbers can all be correct while the visual message is not. Technical accuracy at the level of individual values does not guarantee faithful representation at the level of the figure as a whole.

02 · The Short Answer

A Figure Can Be Numerically Correct and Visually Misleading

In Brief

Yes. A technically accurate figure can still misrepresent the underlying data if choices about axes, scales, aggregation, denominators, uncertainty, normalization, time ranges, visual encoding, or selection create a materially distorted impression of the magnitude, variability, pattern, or certainty of the findings.

Not every imperfect visualization is falsification or misconduct. Researchers should distinguish poor graphical design from a representation that materially misleads, and formal misconduct requires the additional elements specified by the applicable policy.

03 · What You Need to Know

A Figure Communicates More Than the Values Printed on It

Visual Encoding Changes How Readers Perceive the Same Numbers

A graph translates numerical information into visual properties such as position, length, area, angle, shape, color, and spatial arrangement. Readers perceive those visual relationships before, and often more readily than, they inspect individual numbers.

That is why visualization choices matter scientifically. Research on misleading visualizations has documented how inappropriate scaling, shape, spatial orientation, omitted information, and other graphical choices can produce inaccurate impressions even when the underlying values themselves remain unchanged.

A figure should therefore be evaluated at two levels: are the plotted values correct, and does the visual representation communicate their relationships faithfully?

A Truncated Axis Can Magnify a Small Difference

Consider two groups with values of 98 and 100. A bar chart whose vertical axis begins at zero displays the two bars as nearly equal. If the axis begins at 97, the second bar may appear several times taller than the visible portion of the first.

The values 98 and 100 remain perfectly correct. What changes is the perceptual magnitude of their difference.

For bar charts, this is especially consequential because bar length encodes magnitude. Research on misleading graphs therefore commonly identifies truncated axes as a potential source of distortion.

This does not mean every axis in every graph must begin at zero. Line graphs, for example, may legitimately use restricted ranges to show variation that would otherwise be invisible. The appropriate scale depends on the graph type and purpose. The key is whether the choice clarifies the data or creates an exaggerated impression.

Two Axes Can Make Unrelated Trends Look Remarkably Similar

Dual-axis figures allow two variables with different units or ranges to appear on the same plot. By changing the range of either axis, researchers can make trajectories appear more or less aligned.

The underlying data need not change at all.

If the visual alignment encourages readers to infer a relationship stronger than the analysis supports, the figure can become misleading. Axis labels and numerical accuracy do not automatically neutralize the visual impression created by carefully chosen scaling.

Means Can Hide the Distribution Behind Them

Two datasets can have the same mean and very different distributions.

One group might contain tightly clustered observations. Another might contain two distinct subgroups. A third might contain substantial skew or several extreme values. If all three are represented by the same bar height, the figure conceals those differences.

This is one reason visualization guidance increasingly encourages showing individual observations, distributions, box plots, violin plots, or other representations where appropriate rather than relying exclusively on bars showing summary statistics.

The figure is not numerically false because the mean is correct. It may simply be insufficient for the inference readers are likely to make.

Aggregation Can Create a Pattern That Is Not Visible Within the Groups

Combining data across participants, sites, time periods, demographic groups, experimental batches, or other meaningful strata can alter apparent relationships.

An aggregate trend may differ from the patterns within the constituent groups. Conversely, separating data selectively can make a weak overall relationship look striking within a chosen subgroup.

Aggregation is not inherently misleading. Researchers routinely summarize data because figures cannot display every dimension simultaneously. But the level of aggregation should match the research question and should not conceal structure essential to interpreting the result.

Percentages Without Denominators Can Distort Practical Meaning

A figure reports that an event occurred in 50% of Group A and 25% of Group B. That sounds like a substantial difference.

But 50% could mean 1 of 2 participants, while 25% could mean 250 of 1,000. The percentages remain mathematically correct, yet readers lack important information about precision and evidentiary weight.

Denominators also matter when groups differ substantially in size. Reporting raw counts alone can create the opposite problem by making a larger group appear to have a greater rate simply because it contains more observations.

Where interpretation depends on the denominator, figures should make the relevant sample sizes or proportions sufficiently clear.

Relative Change Can Sound Much Larger Than Absolute Change

Suppose an outcome increases from 1% to 2%. That is a 100% relative increase but an absolute increase of one percentage point.

Both descriptions are mathematically correct.

Displaying only the relative increase can nevertheless produce a different impression of practical magnitude from showing the absolute risks. Which representation is appropriate depends on the question, but researchers should consider whether the chosen metric gives readers enough context to interpret the effect.

Uncertainty Is Part of the Result

A point estimate is not the entire statistical result. Sampling uncertainty, variability, measurement error, and other forms of uncertainty may materially affect interpretation.

Visualization guidance has emphasized that omitting uncertainty can itself be misleading. A graph showing two means as precise points may make their difference appear far more definite than a figure showing confidence intervals or the underlying distribution.

Even error bars can be ambiguous if readers are not told whether they represent standard deviations, standard errors, confidence intervals, or something else.

Precision of the Mean Is Not the Same as Predictability of Individual Outcomes

A particularly subtle problem arises when a figure shows narrow confidence intervals around group means. Readers may interpret those narrow intervals as evidence that individual outcomes are tightly concentrated.

They are not the same thing.

Experimental research has shown that displaying only inferential uncertainty can lead even scientifically trained readers to overestimate the predictability or magnitude of effects when individual outcomes remain highly variable.

Where individual variability is important to the substantive claim, showing the underlying observations or distribution can prevent the mean from doing more interpretive work than it deserves.

Normalization Can Clarify Data or Hide Their Original Scale

Researchers often normalize measurements to a baseline, control, maximum value, reference category, or other quantity. This can be analytically appropriate and make comparisons easier.

But normalization can also obscure meaningful differences in the original values.

For example, two groups may both be plotted as “100% of baseline” even though their baseline measurements differ substantially. A figure displaying only normalized values may conceal that difference unless readers are given enough information to understand what was normalized and why.

The issue is not that normalization is inherently misleading. The transformation and reference should be clear enough for readers to interpret the plotted quantities correctly.

A Selective Time Window Can Change the Apparent Trend

A trend can look dramatic over one interval and unremarkable over another.

Starting a time series immediately before an unusual peak, ending it before a reversal, or omitting earlier observations can change the visual narrative without changing any displayed value.

Researchers therefore need a defensible rationale for the period shown. If the figure displays only part of the available time series, readers should not be led to assume that the selected interval represents the broader trend when it does not.

Color and Area Can Exaggerate Differences

Visual magnitude is not communicated only through axes.

If circles represent quantities, doubling the diameter quadruples the area. A reader may therefore perceive a fourfold visual difference when the intended numerical difference is only twofold.

Three-dimensional bars, perspective effects, color saturation, unequal icon scaling, and other design choices can similarly distort perceived magnitude.

A figure may contain accurate labels while its visual encoding communicates something else at first glance.

Selective Data Ranges Can Hide Important Observations

A scatterplot may display only observations between specified limits, leaving extreme values outside the visible range. A histogram may use bin widths that conceal multimodality. A heatmap may use a color scale that compresses variation in one region while exaggerating another.

These choices can sometimes be justified. But researchers should ask what information disappears because of them.

This is closely related to selectively presenting images, cases, quotations, or examples. Selection can occur through graph design as well as through deciding which observations to discuss.

A Figure Can Be Accurate but the Caption Can Make It Misleading

Visual interpretation also depends on labels, legends, captions, and surrounding prose.

A figure may accurately show an association while the caption calls it an “effect.” A graph may show a subgroup while the caption describes the result as applying to the entire sample. Error bars may be present but never defined.

Technical accuracy therefore includes more than pixel placement. The figure and its explanatory text work together as a representation of the research.

Misleading Presentation Is Not Automatically Research Misconduct

Poor figure design can arise from inexperience, software defaults, disciplinary conventions, honest mistakes, or genuine disagreement about the clearest way to display data.

That should not automatically be equated with falsification.

Under the PHS framework, falsification involves manipulating research materials, equipment, or processes, or changing or omitting data or results so that the research is not accurately represented in the research record. A formal misconduct finding additionally requires the specified departure from accepted practices, culpability, and evidentiary standard.

Still, a technically accurate figure should not be treated as beyond integrity scrutiny merely because its individual numbers can be verified. The relevant question remains what the figure represents to the reader.

Watch Out

Do not audit a figure only by asking whether each plotted number is correct. Ask what visual conclusion the figure encourages and whether the complete underlying data support that conclusion. Accuracy of coordinates is not the same as accuracy of communication.

04 · A Practical Example

The Numbers Are Identical, but the Visual Story Changes

Hypothetical Example

Two Groups With a Small Difference

A study compares mean scores between two groups. Group A has a mean of 78 and Group B has a mean of 80.

Figure A: Full-scale bar chart The vertical axis runs from 0 to 100. The two bars appear similar in height, reflecting the two-point difference on the full measurement scale.
Figure B: Truncated bar chart The same values are plotted with the vertical axis beginning at 77.5. Group B's visible bar now towers over Group A's visible bar.
Nothing numerical changed Both figures plot 78 and 80 correctly.
Additional context The underlying participant scores substantially overlap between groups, but neither bar chart displays that distribution.
A more informative presentation The researcher displays the individual observations or distributions, clearly identifies the summary statistic and uncertainty, and uses a scale appropriate to the visual encoding and research question.

The problem was never arithmetic. It was the relationship between correct arithmetic and the impression created by the graphical design.

05 · What Researchers Often Get Wrong

Common Misunderstandings About Accurate but Misleading Figures

Misconception

If Every Number Is Correct, the Figure Is Objective

Visualizations require choices about scale, geometry, aggregation, color, ordering, ranges, and what information to include. Those choices affect interpretation even when every displayed number is correct.

Misconception

Every Graph Must Start at Zero

No. Zero baselines are particularly important when length directly encodes magnitude, as in conventional bar charts. Other graph types may legitimately use restricted ranges. The appropriate scale depends on the visual encoding and analytical purpose, but it should not create a distorted impression.

Misconception

Error Bars Automatically Make a Figure Transparent

Only if readers know what they represent and the chosen uncertainty measure is appropriate to the claim. Standard deviations, standard errors, and confidence intervals answer different questions and should be identified clearly.

Misconception

A Bar Showing the Mean Tells Readers What the Data Look Like

Means can conceal skew, clustering, multimodality, outliers, and substantial overlap. Where the underlying distribution matters, a figure that reveals individual observations or distributional information may be more informative.

Misconception

A Misleading Figure Automatically Proves Falsification

No. Poor visualization and formal research misconduct are not synonymous. Context, accepted practices, the nature of the misrepresentation, evidence concerning how it arose, and the applicable misconduct standard all matter.

06 · What This Means for You

Audit the Impression Your Figure Creates, Not Just the Numbers It Contains

Before finalizing a figure, inspect it as though you had not performed the study. What conclusion would you draw in the first few seconds? Then ask whether that impression survives a careful inspection of the underlying data.

A simple figure-integrity framework

If the figure uses a restricted or transformed axis
Check whether the scale is necessary for interpretation and whether it exaggerates or conceals the practical magnitude of the pattern.
If only summary statistics are shown
Ask whether important distributional information, sample size, or individual variability should also be visible.
If percentages, rates, or relative changes are displayed
Provide the denominators, absolute values, or other context needed to understand their magnitude where relevant.
If uncertainty materially affects interpretation
Display or report an appropriate uncertainty measure and define what it represents.
If the figure shows only a selected range, subgroup, time window, or normalized version
Verify that the selection or transformation does not conceal context that would materially alter the reader's interpretation.

For image-based figures, the same principle applies in a different form. An image can remain technically authentic while cropping, selection, assembly, or processing changes the impression it creates. Researchers should therefore evaluate both how an image was adjusted and whether its final presentation remains faithful to the evidence.

07 · A Quick Checklist

Before Publishing a Figure, Check What Readers Will Actually See

Before finalizing a research figure, check:
Do the visual differences in the figure correspond reasonably to the numerical differences in the underlying data?
Are axis limits, transformations, breaks, and scales clearly identifiable and scientifically defensible?
Does aggregation hide meaningful subgroups, distributions, outliers, or variation relevant to the claim?
Are denominators and sample sizes available where they materially affect interpretation?
Is uncertainty represented appropriately and defined clearly?
Are normalization, transformations, and reference values explained sufficiently to interpret the plotted quantities?
Does the selected time range, subgroup, or data range omit context that would materially change the apparent pattern?
Do the caption and surrounding text describe what the figure actually demonstrates rather than making a stronger claim?
Would displaying more of the underlying data substantially change the reader's first impression?
08 · Frequently Asked Questions

Frequently Asked Questions About Misleading Research Figures

Is a truncated y-axis always misleading?

No. Restricted ranges can be useful, particularly in graph types where showing small changes is important. The risk depends on the visual encoding and whether the scale exaggerates the apparent magnitude. Conventional bar charts deserve particular caution because bar length itself represents magnitude.

Should scientific graphs always show individual data points?

Not always. The appropriate visualization depends on sample size, data type, privacy, analytical purpose, and readability. Where individual variability or distribution is important, however, showing observations or distributional information can prevent summary statistics from hiding relevant structure.

Can a correct percentage still be misleading?

Yes. Percentages can be difficult to interpret without denominators, absolute risks, sample sizes, or appropriate comparison values. A mathematically correct percentage may give an exaggerated or incomplete impression when that context is omitted.

Are dual-axis graphs scientifically acceptable?

They can be used, but they require caution because independently chosen scales can make two trends appear artificially aligned or divergent. Labels and scaling should allow readers to interpret each variable without implying a relationship that the analysis does not support.

Can normalization make a figure misleading?

Potentially. Normalization is often scientifically appropriate, but it can hide meaningful differences in original scales or baselines. Identify the reference and transformation clearly and provide original-scale context when it is important to interpretation.

Does omitting uncertainty make a graph inaccurate?

Not every descriptive figure requires an uncertainty interval, but omission can become misleading when readers need uncertainty or variability to interpret the estimate properly. The figure should contain enough information for the claim it is being used to support.

Can an accurate figure still contribute to falsification?

Potentially, if data or results are presented or omitted in a way that makes the research record inaccurate and the additional requirements of the applicable misconduct standard are met. Numerical correctness alone does not settle whether the research has been represented faithfully.

09 · The Bottom Line

A Figure Should Be Faithful in What It Implies, Not Merely Correct in What It Plots

The Bottom Line

A research figure can contain entirely correct values and still misrepresent the underlying data when its scales, aggregation, denominators, uncertainty, normalization, selection, or visual encoding create a materially distorted impression of the evidence.

Check both numerical accuracy and visual meaning. The most useful question is not simply “Are these values correct?” but “Would a reasonable reader understand the magnitude, variability, uncertainty, and context of these data from the figure I have made?”

10 · Sources and Further Reading

Sources on Accurate and Transparent Data Visualization

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes