Abstract:An increasing number of studies have shown that cross-modal interaction can occur in early sensory cortices. Yet, how neurons in sensory cortices integrate multisensory cues in perceptual tasks and to what extent this influences behavior is largely unclear. To investigate, we examined visual modulation of auditory responses in the primary auditory cortex (A1) in a two-alternative forced-choice task. During the task, male rats were required to make a behavioral choice based on the pure tone frequency (low vs high) of the self-triggered stimulus to get a water reward. The result showed that the presence of a noninformative visual cue did not uniformly influence auditory response, with frequently enhancing just one of them. Closely correlated with behavioral choice, the visual cue mainly enhanced responsiveness to the auditory cue indicating a movement direction contralateral to A1 being recorded. Operating in this fashion provided A1 neurons a superior capability to discriminate sound during multisensory trials. Concomitantly, behavioral data and decoding analysis revealed that visual cue presence could speed the process of sound discrimination. We also observed this differential multisensory integration effect in well-trained rats when tested with passive stimulation and under anesthesia, albeit to a much lesser extent. We did not see this differentially integrative effect while recording in A1 in another similar group of rats performing a free-choice task. These data suggest that auditory cortex can engage in meaningful audiovisual processing, and perceptual learning can modify its multisensory integration mechanism to meet task requirements. SIGNIFICANCE STATEMENT In the natural environment, visual stimuli are frequently accompanied by auditory cues. Although multisensory integration has traditionally been seen as a feature of associational cortices, recent studies have shown that cross-modal inputs can also influence neuronal activity in primary sensory cortices. However, exactly how neurons in sensory cortices integrate multisensory cues to guide behavioral choice is still unclear. Here, we describe a novel model of multisensory integration used by A1 neurons to shape auditory representations when rats performed a cue-guided task. We found that a task-irrelevant visual cue could specifically enhance the response of neurons in sound guiding to the contralateral choice. This differentially integrative model facilitated sound discrimination and behavioral choice. This result indicates that task engagement can modulate multisensory integration.

Visual input modulates audiomotor function via hypothalamic dopaminergic neurons through a cooperative mechanism.

Cross-modality modulation of auditory midbrain processing of intensity information

Multisensory integration enhances audiovisual responses in the Mauthner cell

Crossmodal Modulation As a Basis for Visual Enhancement of Auditory Performance

Sound Improves Neuronal Encoding of Visual Stimuli in Mouse Primary Visual Cortex

Integrating Visual Information into the Auditory Cortex Promotes Sound Discrimination through Choice-Related Multisensory Integration

Visual modulation of auditory evoked potentials in the cat

Direct Auditory Cortical Input to the Lateral Periaqueductal Gray Controls Sound-Driven Defensive Behavior.

Modulation of auditory responses by visual inputs in the mouse auditory cortex

Cross-modal enhancement of defensive behavior via parabigemino-collicular projections

Neural circuits underlying habituation of visually evoked escape behaviors in larval zebrafish

Voltage imaging reveals circuit computations in the raphe underlying serotonin-mediated motor vigor learning

Audiovisual stimuli enhance narrowband gamma activity along the mouse thalamocortical visual circuit

Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation.

Dopamine modulates visual threat processing in the superior colliculus via D2 receptors

Auditory Midbrain Processing is Differentially Modulated by Auditory and Visual Cortices: an Auditory Fmri Study

Enhancement and contextual modulation of visuospatial processing by thalamocollicular projections from ventral lateral geniculate nucleus

Visually-evoked activity and variable modulation of auditory responses in the macaque inferior colliculus

Divergent midbrain circuits orchestrate escape and freezing responses to looming stimuli in mice

Behavioral and Neurogenomic Responses to Acoustic and Visual Sexual Cues are Correlated in Female Torrent Frogs

Vocalization modulates the mouse auditory cortex even in the absence of hearing