Abstract:Previous work has demonstrated that performance in an auditory selective attention task can be enhanced or impaired, depending on whether a task-irrelevant visual stimulus is temporally coherent with a target auditory stream or with a competing distractor. However, it remains unclear how audiovisual (AV) temporal coherence and auditory selective attention interact at the neurophysiological level. Here, we measured neural activity using EEG while human participants (men and women) performed an auditory selective attention task, detecting deviants in a target audio stream. The amplitude envelope of the two competing auditory streams changed independently, while the radius of a visual disk was manipulated to control the AV coherence. Analysis of the neural responses to the sound envelope demonstrated that auditory responses were enhanced largely independently of the attentional condition: both target and masker stream responses were enhanced when temporally coherent with the visual stimulus. In contrast, attention enhanced the event-related response evoked by the transient deviants, largely independently of AV coherence. These results provide evidence for dissociable neural signatures of bottom-up (coherence) and top-down (attention) effects in AV object formation.SIGNIFICANCE STATEMENT Temporal coherence between auditory stimuli and task-irrelevant visual stimuli can enhance behavioral performance in auditory selective attention tasks. However, how audiovisual temporal coherence and attention interact at the neural level has not been established. Here, we measured EEG during a behavioral task designed to independently manipulate audiovisual coherence and auditory selective attention. While some auditory features (sound envelope) could be coherent with visual stimuli, other features (timbre) were independent of visual stimuli. We find that audiovisual integration can be observed independently of attention for sound envelopes temporally coherent with visual stimuli, while the neural responses to unexpected timbre changes are most strongly modulated by attention. Our results provide evidence for dissociable neural mechanisms of bottom-up (coherence) and top-down (attention) effects on audiovisual object formation.

Early Cortical Connective Network Relating To Audiovisual Stimulation By Partial Directed Coherence Analysis

Asymmetrical Cross-Modal Influence on Neural Encoding of Auditory and Visual Features in Natural Scenes.

Cortical networks for audiovisual interactions during visual-affected auditory discrimination

Characterizing the Time-Varying Brain Networks of Audiovisual Integration across Frequency Bands

Cortical Network Underlying Audiovisual Semantic Integration And Modulation Of Attention: An Fmri And Graph-Based Study

Dynamic Correlations Between Intrinsic Connectivity and Extrinsic Connectivity of the Auditory Cortex in Humans

Retinotopic effects during spatial audio-visual integration

Inverted encoding of neural responses to audiovisual stimuli reveals super-additive multisensory enhancement

Laminar organization of visual responses in core and parabelt auditory cortex

Cortical functional connectivity under different auditory attentional efforts.

Using Partial Directed Coherence to Study Alpha-Band Effective Brain Networks during a Visuospatial Attention Task

Congruent Audiovisual Speech Enhances Cortical Envelope Tracking During Auditory Selective Attention.

Neural Processing of Naturalistic Audiovisual Events in Space and Time

Combined diffusion-weighted and functional magnetic resonance imaging reveals a temporal-occipital network involved in auditory-visual object processing

What and where in the auditory systems of sighted and early blind individuals: Evidence from representational similarity analysis

Dissociable Neural Correlates of Multisensory Coherence and Selective Attention

Beyond alpha band: prestimulus local oscillation and interregional synchrony of the beta band shape the temporal perception of the audiovisual beep-flash stimulus

Extracting multidimensional stimulus-response correlations using hybrid encoding-decoding of neural activity

Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation.

Prefrontal Cortex And Somatosensory Cortex In Tactile Crossmodal Association: An Independent Component Analysis Of Erp Recordings

Electrophysiological Evidence of Non-Spatial Inhibition of Return Affecting Audiovisual Integration