Abstract:The visual perception of individuals is thought to be mediated by a network of regions in occipitotemporal cortex that supports specialized processing of faces, bodies, and actions. In comparison, we know relatively little about the neural mechanisms that support the perception of multiple individuals and the interactions between them. The present study sought to elucidate the visual processing of social interactions by identifying which regions of the social perception network represent interpersonal synchrony. In an fMRI study with 32 human participants (26 female, 6 male), we used multi-voxel pattern analysis to investigate whether activity in face-selective, body-selective, and interaction-sensitive regions across the social perception network supports decoding of synchronous vs. asynchronous head-nodding and head-shaking. Several regions were found to support significant decoding of synchrony/asynchrony, including extrastriate body area, face-selective and interaction-sensitive mid/posterior right superior temporal sulcus, and occipital face area. We also saw robust cross-classification across actions in extrastriate body area, suggestive of movement-invariant representations of synchrony/asynchrony. Exploratory whole-brain analyses also identified a region of right fusiform cortex that responded more strongly to synchronous than to asynchronous motion. Critically, perceiving interpersonal synchrony/asynchrony requires the simultaneous extraction and integration of dynamic information from more than one person. Hence, the representation of synchrony/asynchrony cannot be attributed to augmented or additive processing of individual actors. Our findings therefore provide important new evidence that social interactions recruit dedicated visual processing within the social perception network that extends beyond that engaged by the faces and bodies of the constituent individuals. Significance statement The presence of interpersonal synchrony is a critical cue when appraising the nature and content of social interactions from third-person perspectives. However, little is known about its representation within the human visual system. Here, we use fMRI to reveal distributed representations of interpersonal synchrony/asynchrony in several regions of the social perception network, notably extrastriate body area and superior temporal sulcus. There is growing speculation that the perception of social interactions engages specialized visual processing beyond that recruited by the faces and bodies of the constituent individuals. Critically, perceiving interpersonal synchrony requires the simultaneous extraction and integration of dynamic information from more than one person. These results therefore provide key new evidence of dedicated multi-actor processing within the social perception network.

Converging evidence that left extrastriate body area supports visual sensitivity to social interactions

Segregation, connectivity, and gradients of deactivation in neural correlates of evidence in social decision making

Invisible Social Grouping Facilitates the Recognition of Individual Faces.

Boosting forward connectivity between primary visual and body selective cortex reduces interference of task irrelevant dimensions on body judgements

Category-Selective Representation of Relationships in the Visual Cortex

Dissociable roles of the human somatosensory and superior temporal cortices for processing social face signals

The role of the left inferior frontal gyrus in social perception: An rTMS study

Extracting Social Meaning from a Face: The Neural Substrates and Behavioral Repercussions of Mind Perception

Causal Evidence for Expression of Perceptual Expectations in Category-Selective Extrastriate Regions

Neural representations of observed interpersonal synchrony/asynchrony in the social perception network

Behavioral and neural evidence for perceptual predictions in social interactions

Causal evidence for task-specific involvement of the dorsomedial prefrontal cortex in human social cognition

EEG alpha band functional connectivity reveals distinct cortical dynamics for overt and covert emotional face processing

Evidence for Interhemispheric Processing of Inputs From the Hands in Human S2 and PV

Emotional expressions, but not social context, modulate attention during a discrimination task

ERP Evidence on How Gaze Convergence Affects Social Attention

Visual neuroscience: A brain area tuned for processing social interactions

Single-Unit Recordings Reveal the Selectivity of a Human Face Area

Electrophysiological correlates of lateral interactions in human visual cortex

Auditory dyadic interactions through the “eye” of the social brain: How visual is the posterior STS interaction region?

Individual variation in the functional lateralization of human ventral temporal cortex: Local competition and long-range coupling