Abstract:Humans can rapidly encode information from faces to support social judgments and facilitate interactions with others. We can also recall complex knowledge about those individuals, such as their social relationships with others, but the time course of this process has not been examined in detail. This study addressed the temporal dynamics of emerging visual and social relationship information using EEG and representational similarity analysis. Participants (female = 23, male = 10) became familiar with a 10-person social network, and were then shown faces of that network's members while EEG was recorded. To examine the temporal dynamics of the cognitive processes related to face perception, we compared the similarity structure of neural pattern responses to models of visual processing, face shape similarity, person identity, and social relationships. We found that all types of information are associated with neural patterns after a face is seen. Visual models became significant early after image onset, and identity across a change in facial expression was uniquely associated with neural patterns at several points throughout the time course. Additionally, a model reflecting perceived frequency of social interaction was present beginning at ∼110 ms, even in the absence of an explicit task to think about the relationships among the network members. This study highlights the speed and salience of social information relating to group dynamics that are present in the brain during person perception.SIGNIFICANCE STATEMENT We live our lives in social groups where complex relationships form among and around us. It is likely that some of the information about social relationships that we observe is integral during person perception, to better help us interact in differing situations with a variety of people. However, when exactly this information becomes relevant has been unclear. In this study, we present evidence that information reflecting observed relationships among a social network is spontaneously represented in whole-brain patterns shortly following presentation of a face. These results are consistent with neuroimaging studies showing spontaneous spatial representation of social network characteristics, and contribute novel insights into the timing of these neural processes.

Glimpses into the social mind: Decoding messages from faces and eyes.

Extracting Social Meaning from a Face: The Neural Substrates and Behavioral Repercussions of Mind Perception

Social Judgments from Faces Are Universal

Eye Gaze Perception and Gaze Cueing Effect

Temporal Dynamics of the Neural Representation of Social Relationships

Data-driven approaches in the investigation of social perception

It's not all in the face: reduced face visibility does not modulate social segmentation

A New Research Trend in Social Neuroscience: Towards an Interactive-Brain Neuroscience

Gazing at me: the importance of social meaning in understanding direct-gaze cues

Understanding cognitive and affective mechanisms in social psychology through eye-tracking

Social perception of faces in a vision-language model

Charting the Silent Signals of Social Gaze: Automating Eye Contact Assessment in Face-to-Face Conversations

Interpersonal eye-tracking reveals the dynamics of interacting minds

Modelling human social vision with cinematic stimuli

On the social nature of eyes: The effect of social cues in interaction and individual choice tasks

Imagining and Imaging the Social Brain: The Case of Mirror Neurons

Neural Mediators of Altered Perceptual Choice and Confidence Using Social Information

Perceived Gaze Direction Modulates Neural Processing of Prosocial Decision Making.

Looking at other people: mechanisms for social perception revealed in subjects with focal amygdala damage

Understanding Visually Impaired People's Experiences of Social Signal Perception in Face-to-face Communication.

Individual differences in social intelligence and perception of emotion expression of masked and unmasked faces