Abstract:Mature multisensory superior colliculus (SC) neurons integrate information across the senses to enhance their responses to spatiotemporally congruent cross-modal stimuli. The development of this neurotypic feature of SC neurons requires experience with cross-modal cues. In the absence of such experience the response of an SC neuron to congruent cross-modal cues is no more robust than its response to the most effective component cue. This “default” or “naive” state is believed to be one in which cross-modal signals do not interact. The present results challenge this characterization by identifying interactions between visual-auditory signals in male and female cats reared without visual-auditory experience. By manipulating the relative effectiveness of the visual and auditory cross-modal cues that were presented to each of these naive neurons, an active competition between cross-modal signals was revealed. Although contrary to current expectations, this result is explained by a neuro-computational model in which the default interaction is mutual inhibition. These findings suggest that multisensory neurons at all maturational stages are capable of some form of multisensory integration, and use experience with cross-modal stimuli to transition from their initial state of competition to their mature state of cooperation. By doing so, they develop the ability to enhance the physiological salience of cross-modal events thereby increasing their impact on the sensorimotor circuitry of the SC, and the likelihood that biologically significant events will elicit SC-mediated overt behaviors. SIGNIFICANCE STATEMENT The present results demonstrate that the default mode of multisensory processing in the superior colliculus is competition, not non-integration as previously characterized. A neuro-computational model explains how these competitive dynamics can be implemented via mutual inhibition, and how this default mode is superseded by the emergence of cooperative interactions during development.

Hearing How Smooth It Looks: Selective Attention and Crossmodal Perception in the Arts

Asymmetrical Cross-Modal Influence on Neural Encoding of Auditory and Visual Features in Natural Scenes.

Art, Artists, and Perception: A Model for Premotor Contributions to Perceptual Analysis and Form Recognition

Attentional Modulation of Visual Spatial Integration: Psychophysical Evidence Supported by Population Coding Modeling

Selective attention to sound features mediates cross-modal activation of visual cortices

Cross-modal Orienting of Visual Attention.

Attention Drives Visual Processing and Audiovisual Integration During Multimodal Communication

Sensory Processing of Art as a Unique Window into Cognitive Mechanisms: Evidence from Behavioral Experiments and fMRI Studies

Behavioral Indices of Multisensory Integration: Orientation to Visual Cues is Affected by Auditory Stimuli

Involvement of the superior colliculi in crossmodal correspondences

What can computational models learn from human selective attention? A review from an audiovisual crossmodal perspective

Cross-Modal Competition: the Default Computation for Multisensory Processing

A multimodal approach connecting cortical and behavioural responses to the visual continuity illusion

What Can Computational Models Learn From Human Selective Attention? A Review From an Audiovisual Unimodal and Crossmodal Perspective

Temporal and Semantic Effects on Multisensory Integration

The Time Course Of Spatial And Semantic Processing Between Audition And Vision: Evidence From Event-Related Potentials

Are neuronal mechanisms of attention universal across human sensory and motor brain maps?

Spatial and Semantic Processing Between Audition and Vision: an Event-Related Potential Study

Simple and complex crossmodal correspondences involving audition

Neural mechanisms of intermodal sustained selective attention with concurrently presented auditory and visual stimuli

Spatiotemporal models for multisensory integration