Abstract:An increasing number of studies have shown that cross-modal interaction can occur in early sensory cortices. Yet, how neurons in sensory cortices integrate multisensory cues in perceptual tasks and to what extent this influences behavior is largely unclear. To investigate, we examined visual modulation of auditory responses in the primary auditory cortex (A1) in a two-alternative forced-choice task. During the task, male rats were required to make a behavioral choice based on the pure tone frequency (low vs high) of the self-triggered stimulus to get a water reward. The result showed that the presence of a noninformative visual cue did not uniformly influence auditory response, with frequently enhancing just one of them. Closely correlated with behavioral choice, the visual cue mainly enhanced responsiveness to the auditory cue indicating a movement direction contralateral to A1 being recorded. Operating in this fashion provided A1 neurons a superior capability to discriminate sound during multisensory trials. Concomitantly, behavioral data and decoding analysis revealed that visual cue presence could speed the process of sound discrimination. We also observed this differential multisensory integration effect in well-trained rats when tested with passive stimulation and under anesthesia, albeit to a much lesser extent. We did not see this differentially integrative effect while recording in A1 in another similar group of rats performing a free-choice task. These data suggest that auditory cortex can engage in meaningful audiovisual processing, and perceptual learning can modify its multisensory integration mechanism to meet task requirements. SIGNIFICANCE STATEMENT In the natural environment, visual stimuli are frequently accompanied by auditory cues. Although multisensory integration has traditionally been seen as a feature of associational cortices, recent studies have shown that cross-modal inputs can also influence neuronal activity in primary sensory cortices. However, exactly how neurons in sensory cortices integrate multisensory cues to guide behavioral choice is still unclear. Here, we describe a novel model of multisensory integration used by A1 neurons to shape auditory representations when rats performed a cue-guided task. We found that a task-irrelevant visual cue could specifically enhance the response of neurons in sound guiding to the contralateral choice. This differentially integrative model facilitated sound discrimination and behavioral choice. This result indicates that task engagement can modulate multisensory integration.

Crossmodal Modulation As a Basis for Visual Enhancement of Auditory Performance

Asymmetrical Cross-Modal Influence on Neural Encoding of Auditory and Visual Features in Natural Scenes.

Cross-modality modulation of auditory midbrain processing of intensity information

Bi-modal Enhancement Effect from Combination of Visual and Auditory Stimulus

Neural auditory contrast enhancement in humans

Integrating Visual Information into the Auditory Cortex Promotes Sound Discrimination through Choice-Related Multisensory Integration

Cross-modal Enhancement of Spatially Unpredictable Visual Target Discrimination During the Attentional Blink

Auditory Noise Leads to Increased Visual Brain-Computer Interface Performance: A Cross-Modal Study

Cross-modal Representations in Early Visual and Auditory Cortices Revealed by Multi-Voxel Pattern Analysis.

Exploring crossmodal perceptual enhancement and integration in a sequence-reproducing task with cognitive priming

Cross-Modal Selective Attention to Visual and Auditory Stimuli Modulates Endogenous Erp Components

Crossmodal Integration Enhances Neural Representation of Task-Relevant Features in Audiovisual Face Perception

Neural mechanisms of intermodal sustained selective attention with concurrently presented auditory and visual stimuli

An Extended Research of Crossmodal Correspondence Between Color and Sound in Psychology and Cognitive Ergonomics

Intra- and Cross-Modal Cuing of Visual Spatial Attention: the Hyper-Effective Simultaneous Auditory Peripheral Cues

Cross-modal Orienting of Visual Attention.

The interplay between audiovisual temporal synchrony and semantic congruency in the cross-modal boost of the visual target discrimination during the attentional blink

Behavioral Indices of Multisensory Integration: Orientation to Visual Cues is Affected by Auditory Stimuli

Neural Basis of Semantically Dependent and Independent Cross-Modal Boosts on the Attentional Blink

Locating the Sources for Cross-Modal Interactions and Decision Making During Judging the Visual-Affected Auditory Intensity Change.

The Bi-modal Enhancement Effect Between Visual and Somatosensory Stimulus