Abstract:Students who eat breakfast more frequently tend to have a higher grade point average. From this data, many people might confidently state that a before-school breakfast program would lead to higher grades. This is a reasoning error, because correlation does not necessarily indicate causation -- X and Y can be correlated without one directly causing the other. While this error is pervasive, its prevalence might be amplified or mitigated by the way that the data is presented to a viewer. Across three crowdsourced experiments, we examined whether how simple data relations are presented would mitigate this reasoning error. The first experiment tested examples similar to the breakfast-GPA relation, varying in the plausibility of the causal link. We asked participants to rate their level of agreement that the relation was correlated, which they rated appropriately as high. However, participants also expressed high agreement with a causal interpretation of the data. Levels of support for the causal interpretation were not equally strong across visualization types: causality ratings were highest for text descriptions and bar graphs, but weaker for scatter plots. But is this effect driven by bar graphs aggregating data into two groups or by the visual encoding type? We isolated data aggregation versus visual encoding type and examined their individual effect on perceived causality. Overall, different visualization designs afford different cognitive reasoning affordances across the same data. High levels of data aggregation by graphs tend to be associated with higher perceived causality in data. Participants perceived line and dot visual encodings as more causal than bar encodings. Our results demonstrate how some visualization designs trigger stronger causal links while choosing others can help mitigate unwarranted perceptions of causality.

Bringing Visual Inference to the Classroom

Visualization According to Statisticians: An Interview Study on the Role of Visualization for Inferential Statistics

To design interfaces for exploratory data analysis, we need theories of graphical inference

Data Visualization on Day One: Bringing Big Ideas into Intro Stats Early and Often

Teaching and Learning Data Visualization: Ideas and Assignments

Trust Your Gut: Comparing Human and Machine Inference from Noisy Visualizations

Comparing Overlapping Data Distributions Using Visualization

Statistics students' identification of inferential model elements within contexts of their own invention

Visually Communicating and Teaching Intuition for Influence Functions

Univariate Description and Bivariate Statistical Inference: the First Step Delving into Data

Combating anti-statistical thinking using simulation-based methods throughout the undergraduate curriculum

Peeking Inside the Black Box: Visualizing Statistical Learning with Plots of Individual Conditional Expectation

Illusion of Causality in Visualized Data

Inferactive data analysis

Fitting Bell Curves to Data Distributions using Visualization

Repro Samples Method for a Performance Guaranteed Inference in General and Irregular Inference Problems

Statistical inference on representational geometries

InDL: A New Dataset and Benchmark for In-Diagram Logic Interpretation based on Visual Illusion

Pragmatic inference and visual abstraction enable contextual flexibility during visual communication

A comparison of algorithms for inference and learning in probabilistic graphical models

Rolling the DICE (Design, Interpret, Compute, Estimate): Interactive Learning of Biostatistics With Simulations