Abstract:Social communication draws on several cognitive functions such as perception, emotion recognition and attention. The association of audio‐visual information is essential to the processing of species‐specific communication signals. In this study, we use functional magnetic resonance imaging in order to identify the subcortical areas involved in the cross‐modal association of visual and auditory information based on their common social meaning. We identified three subcortical regions involved in audio‐visual processing of species‐specific communicative signals: the dorsolateral amygdala, the claustrum and the pulvinar. These regions responded to visual, auditory congruent and audio‐visual stimulations. However, none of them was significantly activated when the auditory stimuli were semantically incongruent with the visual context, thus showing an influence of visual context on auditory processing. For example, positive vocalization (coos) activated the three subcortical regions when presented in the context of positive facial expression (lipsmacks) but not when presented in the context of negative facial expression (aggressive faces). In addition, the medial pulvinar and the amygdala presented multisensory integration such that audiovisual stimuli resulted in activations that were significantly higher than those observed for the highest unimodal response. Last, the pulvinar responded in a task‐dependent manner, along a specific spatial sensory gradient. We propose that the dorsolateral amygdala, the claustrum and the pulvinar belong to a multisensory network that modulates the perception of visual socioemotional information and vocalizations as a function of the relevance of the stimuli in the social context. Significance statement Understanding and correctly associating socioemotional information across sensory modalities, such that happy faces predict laughter and escape scenes predict screams, is essential when living in complex social groups. With the use of functional magnetic imaging in the awake macaque, we identify three subcortical structures—dorsolateral amygdala, claustrum and pulvinar—that only respond to auditory information that matches the ongoing visual socioemotional context, such as hearing positively valenced coo calls and seeing positively valenced mutual grooming monkeys. We additionally describe task‐dependent activations in the pulvinar, organizing along a specific spatial sensory gradient, supporting its role as a network regulator.

Bred for affection: The canine anterior ectosylvian gyrus responds selectively to social reinforcement

Domestic dogs as a comparative model for social neuroscience: Advances and challenges

A left-lateralized white matter tract associated with communication in domestic dogs

Awake fMRI reveals a specialized region in dog temporal cortex for face processing

The mouth matters most: A functional magnetic resonance imaging study of how dogs perceive inanimate objects

Lateralized behavior and cardiac activity of dogs in response to human emotional vocalizations

Orienting asymmetries and physiological reactivity in dogs’ response to human emotional faces

Representation of rewards differing in their hedonic valence in the caudate nucleus correlates with the performance in a problem-solving task in dogs (Canis familiaris)

A New Paradigm of Learned Cooperation Reveals Extensive Social Coordination and Specific Cortical Activation in Mice

The Processing of Human Emotional Faces by Pet and Lab Dogs: Evidence for Lateralization and Experience Effects

Animal cognition: Dogs build semantic expectations between spoken words and objects

Macaque claustrum, pulvinar and putative dorsolateral amygdala support the cross‐modal association of social audio‐visual stimuli based on meaning

Cellular Activation in Limbic Brain Systems During Social Play Behaviour in Rats

You talkin' to me? Functional breed selection may have fundamentally influenced dogs' sensitivity to human verbal communicative cues

A neurochemical hypothesis for the origin of hominids

Auditory pallial regulation of the social behavior network

Comparative Proteome and Cis-Regulatory Element Analysis Reveals Specific Molecular Pathways Conserved in Dog and Human Brains

Using Neural Circuit Interrogation in Rodents to Unravel Human Speech Decoding

Social cognitive regions of human association cortex are selectively connected to the amygdala

Dogs and humans respond to emotionally competent stimuli by producing different facial actions

Social learning from conspecifics and humans in dog puppies