Abstract:Rats, humans, and monkeys demonstrate robust crossmodal object recognition (CMOR), identifying objects across sensory modalities. We have shown that rats' performance of a spontaneous tactile-to-visual CMOR task requires functional integration of perirhinal (PRh) and posterior parietal (PPC) cortices, which seemingly provide visual and tactile object feature processing, respectively. However, research with primates has suggested that PRh is sufficient for multisensory object representation. We tested this hypothesis in rats using a modification of the CMOR task in which multimodal preexposure to the to-be-remembered objects significantly facilitates performance. In the original CMOR task, with no preexposure, reversible lesions of PRh or PPC produced patterns of impairment consistent with modality-specific contributions. Conversely, in the CMOR task with preexposure, PPC lesions had no effect, whereas PRh involvement was robust, proving necessary for phases of the task that did not require PRh activity when rats did not have preexposure; this pattern was supported by results from c-fos imaging. We suggest that multimodal preexposure alters the circuitry responsible for object recognition, in this case obviating the need for PPC contributions and expanding PRh involvement, consistent with the polymodal nature of PRh connections and results from primates indicating a key role for PRh in multisensory object representation. These findings have significant implications for our understanding of multisensory information processing, suggesting that the nature of an individual's past experience with an object strongly determines the brain circuitry involved in representing that object's multisensory features in memory. Significance statement: The ability to integrate information from multiple sensory modalities is crucial to the survival of organisms living in complex environments. Appropriate responses to behaviorally relevant objects are informed by integration of multisensory object features. We used crossmodal object recognition tasks in rats to study the neurobiological basis of multisensory object representation. When rats had no prior exposure to the to-be-remembered objects, the spontaneous ability to recognize objects across sensory modalities relied on functional interaction between multiple cortical regions. However, prior multisensory exploration of the task-relevant objects remapped cortical contributions, negating the involvement of one region and significantly expanding the role of another. This finding emphasizes the dynamic nature of cortical representation of objects in relation to past experience.

Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study

Perceptual Integration Rapidly Activates Dorsal Visual Pathway to Guide Local Processing in Early Visual Areas

Attention Drives Visual Processing and Audiovisual Integration During Multimodal Communication

Behavioral Indices of Multisensory Integration: Orientation to Visual Cues is Affected by Auditory Stimuli

The Dynamic Multisensory Engram: Neural Circuitry Underlying Crossmodal Object Recognition in Rats Changes with the Nature of Object Experience

The auditory-visual multisensory neurons and auditory-visual information integration in rat cortex

Semantic Congruent Audiovisual Integration During the Encoding Stage of Working Memory: an ERP and Sloreta Study

Inverted encoding of neural responses to audiovisual stimuli reveals super-additive multisensory enhancement

Auditory-visual integration during nonconscious perception

Integrating Visual Information into the Auditory Cortex Promotes Sound Discrimination through Choice-Related Multisensory Integration

The Interplay Between Multisensory Processing and Attention in Working Memory: Behavioral and Neural Indices of Audio-Visual Object Storage

Multisensory processing of naturalistic objects in motion: a high-density electrical mapping and source estimation study

Retinotopic effects during spatial audio-visual integration

Neural Basis of Anticipatory Multisensory Integration

Combined diffusion-weighted and functional magnetic resonance imaging reveals a temporal-occipital network involved in auditory-visual object processing

Cross-Modal Integration of Reward Value during Oculomotor Planning

Multisensory integration operates on correlated input from unimodal transients channels

Unconscious multisensory integration: behavioral and neural evidence from subliminal stimuli

Temporal and Semantic Effects on Multisensory Integration

Crossmodal Integration Enhances Neural Representation of Task-Relevant Features in Audiovisual Face Perception

Neural correlates of multisensory integration in the human brain: an ALE meta-analysis