Abstract:In everyday life, we integrate visual and auditory information in routine tasks such as navigation and communication. While concurrent sound can improve visual perception, the neuronal correlates of audiovisual integration are not fully understood. Specifically, it remains unclear whether neuronal firing patters in the primary visual cortex (V1) of awake animals demonstrate similar sound-induced improvement in visual discriminability. Furthermore, presentation of sound is associated with movement in the subjects, but little is understood about whether and how sound-associated movement affects audiovisual integration in V1. Here, we investigated how sound and movement interact to modulate V1 visual responses in awake, head-fixed mice and whether this interaction improves neuronal encoding of the visual stimulus. We presented visual drifting gratings with and without simultaneous auditory white noise to awake mice while recording mouse movement and V1 neuronal activity. Sound modulated activity of 80% of light-responsive neurons, with 95% of neurons increasing activity when the auditory stimulus was present. A generalized linear model (GLM) revealed that sound and movement had distinct and complementary effects of the neuronal visual responses. Furthermore, decoding of the visual stimulus from the neuronal activity was improved with sound, an effect that persisted even when controlling for movement. These results demonstrate that sound and movement modulate visual responses in complementary ways, improving neuronal representation of the visual stimulus. This study clarifies the role of movement as a potential confound in neuronal audiovisual responses and expands our knowledge of how multimodal processing is mediated at a neuronal level in the awake brain.SIGNIFICANCE STATEMENT Sound and movement are both known to modulate visual responses in the primary visual cortex; however, sound-induced movement has largely remained unaccounted for as a potential confound in audiovisual studies in awake animals. Here, authors found that sound and movement both modulate visual responses in an important visual brain area, the primary visual cortex, in distinct, yet complementary ways. Furthermore, sound improved encoding of the visual stimulus even when accounting for movement. This study reconciles contrasting theories on the mechanism underlying audiovisual integration and asserts the primary visual cortex as a key brain region participating in tripartite sensory interactions.

Associative responses to visual shape stimuli in the mouse auditory cortex

Modulation of Azimuth Tuning Plasticity in Rat Primary Auditory Cortex by Medial Prefrontal Cortex

Piriform cortical glutamatergic and GABAergic neurons express coordinated plasticity for whisker-induced odor recall

Higher visual responses in the temporal cortex of mice

Neuronal Representation of Audio-Place Associations in the Medial Prefrontal Cortex of Rats

Learning-Induced Odor Modulation of Neuronal Activity in Auditory Cortex

Multisensory-Guided Associative Learning Enhances Multisensory Representation in Primary Auditory Cortex.

Experience-Dependent Coding of Time-Dependent Frequency Trajectories by Off Responses in Secondary Auditory Cortex

The Behavioral Presentations of Audio-Visual Integration in Rats

Cross-Modal Interaction Between Auditory and Visual Input Impacts Memory Retrieval

Heterosynaptic plasticity of the visuo-auditory projection requires cholecystokinin released from entorhinal cortex afferents

Sound Improves Neuronal Encoding of Visual Stimuli in Mouse Primary Visual Cortex

A Protracted Sensitive Period Regulates the Development of Cross-Modal Sound-Shape Associations in Humans

Frequency-Dependent Plasticity in the Temporal Association Cortex Originates from the Primary Auditory Cortex, and Is Modified by the Secondary Auditory Cortex and the Medial Geniculate Body

Developmental encoding of natural sounds in the mouse auditory cortex

Single-neuron Representation of Learned Complex Sounds in the Auditory Cortex

A Comparison of Neural Responses in the Primary Auditory Cortex, Amygdala, and Medial Prefrontal Cortex of Cats During Auditory Discrimination Tasks

Mouse visual cortex areas represent perceptual and semantic features of learned visual categories

Rapid formation of picture-word association in cats

Experience-dependent coding of frequency-modulated trajectories by offsets in auditory cortex

Auditory Cortex Learns to Discriminate Audiovisual Cues through Selective Multisensory Enhancement