Abstract:Scene Perception and Event Comprehension Theory (SPECT) posits that understanding picture stories depends upon a coordination of two processes: (1) integrating new information into the current event model that is coherent with it (i.e., mapping) and (2) segmenting experiences into distinct event models (i.e., shifting). In two experiments, we investigated competing hypotheses regarding how viewers coordinate the mapping process of bridging inference generation and the shifting process of event segmentation by manipulating the presence/absence of Bridging Action pictures (i.e., creating coherence gaps) in wordless picture stories. The Computational Effort Hypothesis says that experiencing a coherence gap prompts event segmentation and the additional computational effort to generate bridging inferences. Thus, it predicted a positive relationship between event segmentation and explanations when Bridging Actions were absent. Alternatively, the Coherence Gap Resolution Hypothesis says that experiencing a coherence gap prompt generating a bridging inference to close the gap, which obviates segmentation. Thus, it predicted a negative relationship between event segmentation and the production of explanations. Replicating prior work, viewers were more likely to segment and generate explanations when Bridging Action pictures were absent than when they were present. Crucially, the relationship between explanations and segmentation was negative when Bridging Action pictures were absent, consistent with the Coherence Gap Resolution Hypothesis. Unexpectedly, the relationship was positive when Bridging Actions were present. The results are consistent with SPECT's assumption that mapping and shifting processes are coordinated, but how they are coordinated depends upon the experience of a coherence gap.

Anaphoric distance dependencies in visual narrative structure and processing

An electrophysiological investigation of co-referential processes in visual narrative comprehension

What is your neural function, visual narrative conjunction? Grammar, meaning, and fluency in sequential image processing

Being explicit about the implicit: inference generating techniques in visual narrative

Visual narrative comprehension: Universal or not?

Your Brain on Comics: A Cognitive Model of Visual Narrative Comprehension

Anaphora and Discourse Structure

Integrating Visuospatial, Linguistic and Commonsense Structure into Story Visualization

Coordination and Referential Dependencies: a Dependency Grammar Account in Terms of Predicate-Valent Structures

Understanding Narrative Linearity for Telling Expressive Time-Oriented Stories

Zooming in on visual narrative comprehension

Individual differences in the neural dynamics of visual narrative comprehension: The effects of proficiency and age of acquisition

A Customizable Generator for Comic-Style Visual Narrative

A multimodal parallel architecture: A cognitive framework for multimodal interactions

The Influence of Chunking on Dependency Crossing and Distance

The properties of rare and complex syntactic constructions in English. A corpus-based comparative study

The Role of Working Memory in Shaping Syntactic Dependency Structures

Fine-Grained Modeling of Narrative Context: A Coherence Perspective via Retrospective Questions

Bridging a Gap in Coherence: The Coordination of Comprehension Processes When Viewing Visual Narratives

The Amazing Mysteries of the Gutter: Drawing Inferences Between Panels in Comic Book Narratives

Space, Time, and Story