Abstract:Previous work has demonstrated that performance in an auditory selective attention task can be enhanced or impaired, depending on whether a task-irrelevant visual stimulus is temporally coherent with a target auditory stream or with a competing distractor. However, it remains unclear how audiovisual (AV) temporal coherence and auditory selective attention interact at the neurophysiological level. Here, we measured neural activity using EEG while human participants (men and women) performed an auditory selective attention task, detecting deviants in a target audio stream. The amplitude envelope of the two competing auditory streams changed independently, while the radius of a visual disk was manipulated to control the AV coherence. Analysis of the neural responses to the sound envelope demonstrated that auditory responses were enhanced largely independently of the attentional condition: both target and masker stream responses were enhanced when temporally coherent with the visual stimulus. In contrast, attention enhanced the event-related response evoked by the transient deviants, largely independently of AV coherence. These results provide evidence for dissociable neural signatures of bottom-up (coherence) and top-down (attention) effects in AV object formation.SIGNIFICANCE STATEMENT Temporal coherence between auditory stimuli and task-irrelevant visual stimuli can enhance behavioral performance in auditory selective attention tasks. However, how audiovisual temporal coherence and attention interact at the neural level has not been established. Here, we measured EEG during a behavioral task designed to independently manipulate audiovisual coherence and auditory selective attention. While some auditory features (sound envelope) could be coherent with visual stimuli, other features (timbre) were independent of visual stimuli. We find that audiovisual integration can be observed independently of attention for sound envelopes temporally coherent with visual stimuli, while the neural responses to unexpected timbre changes are most strongly modulated by attention. Our results provide evidence for dissociable neural mechanisms of bottom-up (coherence) and top-down (attention) effects on audiovisual object formation.

Task-guided attention increases non-linearity of steady-state visually evoked potentials

Visual Target Detection in a Distracting Background Relies on Neural Encoding of Both Visual Targets and Background.

Effect of sustained selective attention on steady-state visual evoked potentials

Attentional Engagement and Disengagement: Quantifying Attentional Shifts Utilizing the Steady State Visual Evoked Potentials

Exploring the Temporal Dynamics of Sustained and Transient Spatial Attention Using Steady-State Visual Evoked Potentials

Anticipatory and evoked visual cortical dynamics of voluntary temporal attention

Neural mechanisms of intermodal sustained selective attention with concurrently presented auditory and visual stimuli

Attention to Detail: Why Considering Task Demands Is Essential for Single-Trial Analysis of BOLD Correlates of the Visual P1 and N1

Supramodal selective attention differentially adjusts frequency and phase of entrained oscillations in primary sensory areas and the dorsal attention network

Task-related modulation of event-related potentials does not reflect changes to sensory representations

Opposing neural processing modes alternate rhythmically during sustained auditory attention

Parietal alpha stimulation causally enhances attentional information coding in evoked and oscillatory activity

Task-dependent neural representations of salient events in dynamic auditory scenes

The power of human brain magnetoencephalographic signals can be modulated up or down by changes in an attentive visual task

Exploring steady-state visual evoked potentials as an index for intermodal and crossmodal spatial attention.

Dissociable Neural Correlates of Multisensory Coherence and Selective Attention

No effects of rhythmic visual stimulation on target discrimination: An online alpha entrainment experiment

Transcranial Alternating Current Stimulation over Frontal Eye Fields Mimics Attentional Modulation of Visual Processing

Attention strengthens across-trial pre-stimulus phase coherence in visual cortex, enhancing stimulus processing

Attention rhythmically shapes sensory tuning