Mapping patterns of thought onto brain activity during movie-watching

Raven S. Wallace,Brontë Mckeown,Ian Goodall-Halliwell,Louis Chitiz,Philippe Forest,Theodoros Karapanagiotidis,Bridget Mulholland,Adam G Turnbull,Tamera Vanderwal,Samyogita Hardikar,Tirso Gonzalez Alam,Boris Bernhardt,Hao-Ting Wang,Will Strawson,Michael Milham,Ting Xu,Daniel Margulies,Giulia L. Poerio,Elizabeth S. Jefferies,Jeremy I. Skipper,Jeffery Wammes,Robert Leech,Jonathan Smallwood

DOI: https://doi.org/10.1101/2024.01.31.578244

2024-03-09

Abstract:Movie watching is a central aspect of our lives and an important paradigm for understanding the brain mechanisms behind cognition as it occurs in daily life. Contemporary views of ongoing thought argue that the ability to make sense of events in the ‘here and now’ depend on the neural processing of incoming sensory information by auditory and visual cortex, which are kept in check by systems in association cortex. However, we currently lack an understanding of how patterns of ongoing thoughts map onto the different brain systems when we watch a film, partly because methods of sampling experience disrupt the dynamics of brain activity and the movie-watching experience. Our study established a novel method for mapping thought patterns onto the brain activity that occurs at different moments of a film, which does not disrupt the time course of brain activity or the movie-watching experience. We found moments when experience sampling highlighted engagement with multi-sensory features of the film or highlighted thoughts with episodic features, regions of sensory cortex were more active and subsequent memory for events in the movie was better—on the other hand, periods of intrusive distraction emerged when activity in regions of association cortex within the frontoparietal system was reduced. These results highlight the critical role sensory systems play in the multi-modal experience of movie-watching and provide evidence for the role of association cortex in reducing distraction when we watch films.

Neuroscience

What problem does this paper attempt to address?

The paper aims to address the following key issues:

### Research Background and Objectives
- **Research Background**: Watching movies, as an important activity in daily life, is significant for understanding how the brain processes cognitive tasks in the real world. Existing research methods (such as experience sampling) may interfere with the natural dynamics of brain activity when attempting to capture cognitive states during movie watching, thereby limiting our understanding of the mapping between brain activity and cognitive states.

- **Core Issue**: The core issue of this study is to develop a new method to accurately map different cognitive states to different moments of brain activity during movie watching, while minimizing interference with the natural flow of brain activity and the movie-watching experience.

### Specific Objectives
- **Method Innovation**: Propose a novel method that minimizes the interference of experience sampling on participants and brain dynamics, to link different experiential states during movie watching with brain activity.

- **Mapping Patterns**: The goal of the study is to understand the association between brain activity patterns at specific moments during movie watching and the accompanying continuous thinking patterns, particularly focusing on changes in brain region activity under sensory engagement and distraction states.

- **Theoretical Contribution**: This study helps to reveal the key role of the sensory system in the multimodal movie-watching experience and provides evidence on the role of the associative cortex in inhibiting distractions.

In short, the main objective of this paper is to explore the mapping relationship between brain activity and cognitive states during movie watching through an innovative method, particularly focusing on the characteristics of brain activity changes under sensory engagement and attention distraction states.