Abstract:Providing single-modality cueing (either visual cueing or auditory cueing) in multimedia lessons does not consistently improve learning outcomes. In 3 eye-tracking experiments, some students learned an onscreen lesson with an oral explanation of graphics and then took a posttest on the material (no cues group). Across all 3 experiments, students spent more time attending to the relevant portion of the graphic and performed better on posttests if coordinated cues were added to the lesson (coordinated dual cues group), in which key elements were spoken with deeper intonation (auditory cue) at the same time the element turned red in the graphic (visual cue). Presenting coordinated visual and auditory cues also resulted in better posttest performance than presenting only a visual cue (visual-only cues group) or auditory cue alone (auditory-only cues group) in Experiment 1, or presenting visual and auditory cues that were unmatched (mismatched dual cues group) in Experiment 2 or unsynchronized (visual-before-auditory cues group and visual-after-auditory cues group) in Experiment 3. These findings extend and sharpen the signaling principle concerning how best to highlight instructional material in multimedia learning, using coordinated auditory and visual cues. Educational Impact and Implications Statement When students receive an onscreen lesson with an oral explanation of graphics, they may not know where to look on the screen. In 3 experiments, students spent more time attending to the relevant portion of the graphic and performed better on posttests if coordinated cues were added in which key elements were spoken with deeper intonation (auditory cue) at the same time the element turned red in the graphic (visual cue). Presenting coordinated visual and auditory cues also resulted in better performance than presenting only a visual cue or auditory cue alone or presenting the two cues in unmatched or unsynchronized ways. Students benefit from coordinated visual and auditory cues when learning from an online lecture with narrated graphics.

Coordinating Visual and Auditory Cueing in Multimedia Learning

An Eye Tracking Study: Positive Emotional Interface Design Facilitates Learning Outcomes in Multimedia Learning?

The effect of instructor's voice enthusiasm and visual cueing in multimedia learning

How textual and picture cues influence motor skill learning in short instructional videos: Evidence from eye-tracking experiments

The Effect of Cue Labeling in Multimedia Learning: Evidence From Eye Tracking

The Impact of Color Cues on the Learning Performance in Video Lectures

Multimedia instructions and cognitive load theory: Effects of modality and cueing

The promise of multimedia learning: using the same instructional design methods across different media

Previewing test items prior to learning and receiving decorative pictures during testing: Impact on listening comprehension for English as a Foreign Language students

A study on the effect of different channel cues on learning in immersive 360° videos

Picture This: Studying the Effectiveness of Illustrated Instructions

The Visual Presentation in Multimedia Courseware: Design and Assessment

How Technology Should Be Committed to the Promotion of Learning:Mayer's View on Multimedia Learning and Teaching Designing

Multimedia Instructional Design Corresponded to Cognitive Psychology

Effects of Explaining a Science Lesson to Others or to Oneself: A Cognitive Neuroscience Approach

A meta-analysis of signaling principle in multimedia learning environments

The Behavioral Presentations of Audio-Visual Integration in Rats

Impacts of Color Coding on Programming Learning in Multimedia Learning: Moving Toward a Multimodal Methodology

An Eye-tracking Experiment Research on Three-part-separated Screen Web Course

Organization Principles in Visual Working Memory: Evidence from Sequential Stimulus Display

The Four-Component Instructional Design Model: Multimedia Principles in Environments for Complex Learning