Abstract:Social communication draws on several cognitive functions such as perception, emotion recognition and attention. The association of audio‐visual information is essential to the processing of species‐specific communication signals. In this study, we use functional magnetic resonance imaging in order to identify the subcortical areas involved in the cross‐modal association of visual and auditory information based on their common social meaning. We identified three subcortical regions involved in audio‐visual processing of species‐specific communicative signals: the dorsolateral amygdala, the claustrum and the pulvinar. These regions responded to visual, auditory congruent and audio‐visual stimulations. However, none of them was significantly activated when the auditory stimuli were semantically incongruent with the visual context, thus showing an influence of visual context on auditory processing. For example, positive vocalization (coos) activated the three subcortical regions when presented in the context of positive facial expression (lipsmacks) but not when presented in the context of negative facial expression (aggressive faces). In addition, the medial pulvinar and the amygdala presented multisensory integration such that audiovisual stimuli resulted in activations that were significantly higher than those observed for the highest unimodal response. Last, the pulvinar responded in a task‐dependent manner, along a specific spatial sensory gradient. We propose that the dorsolateral amygdala, the claustrum and the pulvinar belong to a multisensory network that modulates the perception of visual socioemotional information and vocalizations as a function of the relevance of the stimuli in the social context. Significance statement Understanding and correctly associating socioemotional information across sensory modalities, such that happy faces predict laughter and escape scenes predict screams, is essential when living in complex social groups. With the use of functional magnetic imaging in the awake macaque, we identify three subcortical structures—dorsolateral amygdala, claustrum and pulvinar—that only respond to auditory information that matches the ongoing visual socioemotional context, such as hearing positively valenced coo calls and seeing positively valenced mutual grooming monkeys. We additionally describe task‐dependent activations in the pulvinar, organizing along a specific spatial sensory gradient, supporting its role as a network regulator.

Social and nonsocial content differentially modulates visual attention and autonomic arousal in Rhesus macaques

Evidence That Emotion Mediates Social Attention in Rhesus Macaques

Social Interactions Through the Eyes of Macaques and Humans

Dopamine-dependent visual attention preference to social stimuli in nonhuman primates

The Development of Socially Directed Attention: An Functional Magnetic Resonance Imaging Study in Infant Monkeys

Videos of conspecifics elicit interactive looking patterns and facial expressions in monkeys.

Primate social attention: Species differences and effects of individual experience in humans, great apes, and macaques

Beyond faces: the contribution of the amygdala to visual processing in the macaque brain

Heritability and maternal effects on social attention during an attention bias task in a non-human primate, Macaca mulatta

Maternal immune activation in nonhuman primates alters social attention in juvenile offspring

Behavioral and neural mechanisms of face-specific attention during goal-directed visual search

Effect of distracting faces on visual selective attention in the monkey

Neural signatures of natural behaviour in socializing macaques

Seeing Two Faces Together: Preference Formation in Humans and Rhesus Macaques.

Selective and prolonged attention to emotional scenes in humans and bonobos

Oxytocin and social gaze during a dominance categorization task in tufted capuchin monkeys

Differential Behavior Patterns in Cynomolgus Monkey Macaca Fascicularis in Home Cage in Response to Human Gaze.

Eye‐tracking as a window into primate social cognition

Macaque claustrum, pulvinar and putative dorsolateral amygdala support the cross‐modal association of social audio‐visual stimuli based on meaning

Do Animals Engage Greater Social Attention in Autism? An Eye Tracking Analysis

Real Face Value: The Processing of Naturalistic Facial Expressions in the Macaque Inferior Temporal Cortex