Multidimensional neural representations of social features during movie viewing

Haemy Lee Masson,Lucy Chang,Leyla Isik
DOI: https://doi.org/10.1093/scan/nsae030
IF: 4.235
2024-05-10
Social Cognitive and Affective Neuroscience
Abstract:The social world is dynamic and contextually embedded. Yet, most studies utilize simple stimuli that do not capture the complexity of everyday social episodes. To address this, we implemented a movie viewing paradigm and investigated how the everyday social episodes are processed in the brain. Participants watched one of two movies during an MRI scan. Neural patterns from brain regions involved in social perception, mentalization, action observation, and sensory processing were extracted. Representational similarity analysis results revealed that several labeled social features (including social interaction, mentalization, the actions of others, characters talking about themselves, talking about others, and talking about objects) were represented in superior temporal gyrus (STG) and middle temporal gyrus (MTG). The mentalization feature was also represented throughout the theory of mind network, and characters talking about others engaged the temporoparietal junction (TPJ), suggesting that listeners may spontaneously infer the mental state of those being talked about. In contrast, we did not observe the action representations in frontoparietal regions of the action observation network. The current findings indicate that STG and MTG serve as key regions for social processing, and that listening to characters talk about others elicits spontaneous mental state inference in TPJ during natural movie viewing.
psychology, experimental,neurosciences
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how the brain processes complex social features in the context of natural movie - watching. Specifically, through the movie - watching paradigm, the researchers explored how the brain regions related to social perception, mentalizing, action observation, and sensory processing in the brain represent these social features when watching daily social scenes. The study focused on how multiple - labeled social features, including social interaction, mentalizing, others' actions, characters talking about themselves, talking about others, and talking about objects, etc., are represented in the brain. By using representational similarity analysis (RSA), the researchers aimed to reveal the specific representation patterns of these social features in the brain, especially the performance of these features in the superior temporal gyrus (STG) and middle temporal gyrus (MTG), as well as the spontaneous mental state inference process triggered in the temporoparietal junction (TPJ) when listening to characters talking about others. In addition, the study also explored the differences in the representation of different social - content speech (self, others, or things) in the brain, in order to more comprehensively understand the neural mechanisms of complex social processes in the real - world context.