Abstract:The visual perception of individuals is thought to be mediated by a network of regions in occipitotemporal cortex that supports specialized processing of faces, bodies, and actions. In comparison, we know relatively little about the neural mechanisms that support the perception of multiple individuals and the interactions between them. The present study sought to elucidate the visual processing of social interactions by identifying which regions of the social perception network represent interpersonal synchrony. In an fMRI study with 32 human participants (26 female, 6 male), we used multi-voxel pattern analysis to investigate whether activity in face-selective, body-selective, and interaction-sensitive regions across the social perception network supports decoding of synchronous vs. asynchronous head-nodding and head-shaking. Several regions were found to support significant decoding of synchrony/asynchrony, including extrastriate body area, face-selective and interaction-sensitive mid/posterior right superior temporal sulcus, and occipital face area. We also saw robust cross-classification across actions in extrastriate body area, suggestive of movement-invariant representations of synchrony/asynchrony. Exploratory whole-brain analyses also identified a region of right fusiform cortex that responded more strongly to synchronous than to asynchronous motion. Critically, perceiving interpersonal synchrony/asynchrony requires the simultaneous extraction and integration of dynamic information from more than one person. Hence, the representation of synchrony/asynchrony cannot be attributed to augmented or additive processing of individual actors. Our findings therefore provide important new evidence that social interactions recruit dedicated visual processing within the social perception network that extends beyond that engaged by the faces and bodies of the constituent individuals. Significance statement The presence of interpersonal synchrony is a critical cue when appraising the nature and content of social interactions from third-person perspectives. However, little is known about its representation within the human visual system. Here, we use fMRI to reveal distributed representations of interpersonal synchrony/asynchrony in several regions of the social perception network, notably extrastriate body area and superior temporal sulcus. There is growing speculation that the perception of social interactions engages specialized visual processing beyond that recruited by the faces and bodies of the constituent individuals. Critically, perceiving interpersonal synchrony requires the simultaneous extraction and integration of dynamic information from more than one person. These results therefore provide key new evidence of dedicated multi-actor processing within the social perception network.

Evidence for a role of synchrony but not common fate in the perception of biological group movements

Shared Rhythm to Shared Vision: Synchronous Marching increases Conformity on Perceptual Decision making

Cooperative but Not Competitive Relationship Drives Perceptual Grouping of Objects

Social Grouping: Perceptual Grouping of Objects by Cooperative but Not Competitive Relationships in Dynamic Chase

A New Research Trend in Social Neuroscience: Towards an Interactive-Brain Neuroscience

Identifying Signatures of Perceived Interpersonal Synchrony

Synchrony and Physiological Arousal Increase Cohesion and Cooperation in Large Naturalistic Groups

Movement synchrony among dance performers predicts brain synchrony among dance spectators

Spontaneous movement synchrony as an exogenous source for interbrain synchronization in cooperative learning

The relevance to social interaction modulates bistable biological-motion perception

Spatial Heterogeneity of Biological Motion Perception

The Effects of Synchrony on Group Moral Hypocrisy

Hunting for the beat in the body: on period and phase locking in music-induced movement

You are in sync with me: Neural correlates of interpersonal synchrony with a partner

Perception of audio-visual synchrony is modulated by walking speed and step cycle phase

Neural representations of observed interpersonal synchrony/asynchrony in the social perception network

Blending into the Crowd: Electrophysiological Evidence of Gestalt Perception of a Human Dyad

Following Other People's Footsteps: A Contextual-Attraction Effect Induced by Biological Motion

Tuning in to a hip-hop beat: Pursuit eye movements reveal processing of biological motion

Measuring information alignment in hyperscanning research with representational analyses: moving beyond interbrain synchrony

Mutual gaze and movement synchrony boost observers' enjoyment and perception of togetherness when watching dance duets