Abstract:How do people internalize visualizations: as images or information? In this study, we investigate the nature of internalization for visualizations (i.e., how the mind encodes visualizations in memory) and how memory encoding affects its retrieval. This exploratory work examines the influence of various design elements on a user's perception of a chart. Specifically, which design elements lead to perceptions of visualization as an image or as information? Understanding how design elements contribute to viewers perceiving a visualization more as an image or information will help designers decide which elements to include to achieve their communication goals. For this study, we annotated 500 visualizations and analyzed the responses of 250 online participants, who rated the visualizations on a bilinear scale as image or information. We then conducted an in-person study (n = 101) using a free recall task to examine how the image/information ratings and design elements impact memory. The results revealed several interesting findings: Image-rated visualizations were perceived as more aesthetically appealing, enjoyable, and pleasing. Information-rated visualizations were perceived as less difficult to understand and more aesthetically likable and nice, though participants expressed higher positive sentiment when viewing image-rated visualizations and felt less guided to a conclusion. We also found different patterns among participants that were older. Importantly, we show that visualizations internalized as images are less effective in conveying trends and messages, though they elicit a more positive emotional judgment, while informative visualizations exhibit annotation focused recall and elicit a more positive design judgment. We discuss the implications of this dissociation between aesthetic pleasure and perceived ease of use in visualization design.

Effects of Illustrations on Retention and Visual Attention Using Authentic Textbooks

Picture This: Studying the Effectiveness of Illustrated Instructions

An Eye Tracking Study: Positive Emotional Interface Design Facilitates Learning Outcomes in Multimedia Learning?

The effects of visuals versus no visuals on learning outcomes from interactive multimedia instruction

Utilization of Illustrations during Learning of Science Textbook Passages among Low- and High-Ability Children.

Effects of instructor-provided visuals on learner-generated explanations

There's more to the multimedia effect than meets the eye: is seeing pictures believing?

The Role of Spatial Ability and Attention Shifting in Reading of Illustrated Scientific Texts: An Eye Tracking Study

Effects of Explaining a Science Lesson to Others or to Oneself: A Cognitive Neuroscience Approach

Effects of student-generated drawing and imagination on science text reading in a computer-based learning environment

Designing instructional media for severely retarded adolescents: a theoretical approach to trait-treatment interaction research

The effect of instructor's voice enthusiasm and visual cueing in multimedia learning

Student Perceptions of the Instructional Effectiveness of Black & White and Colored Illustrations

Increasing the realism of on‐screen embodied instructors creates more looking but less learning

Multimedia instructions and cognitive load theory: Effects of modality and cueing

Examining the Effects of Embodied Interaction Modalities on Students’ Retention Skills in a Real Classroom Context

Cognitive effects of humorous drawings on learning: An eye‐tracking study

EFFECTS OF LEARNER-CENTERED INTERVENTIONS IN SCIENCE LEARNING: COMPARING EYE MOVEMENT IN EYE MOVEMENT MODELING EXAMPLES AND PROMPTING

Learner-generated explanations: effects on restudying and learning from a multimedia lesson

Image or Information? Examining the Nature and Impact of Visualization Perceptual Classification

A comparison of animated versus static images in an instructional multimedia presentation