Abstract:Previous work has demonstrated that performance in an auditory selective attention task can be enhanced or impaired, depending on whether a task-irrelevant visual stimulus is temporally coherent with a target auditory stream or with a competing distractor. However, it remains unclear how audiovisual (AV) temporal coherence and auditory selective attention interact at the neurophysiological level. Here, we measured neural activity using EEG while human participants (men and women) performed an auditory selective attention task, detecting deviants in a target audio stream. The amplitude envelope of the two competing auditory streams changed independently, while the radius of a visual disk was manipulated to control the AV coherence. Analysis of the neural responses to the sound envelope demonstrated that auditory responses were enhanced largely independently of the attentional condition: both target and masker stream responses were enhanced when temporally coherent with the visual stimulus. In contrast, attention enhanced the event-related response evoked by the transient deviants, largely independently of AV coherence. These results provide evidence for dissociable neural signatures of bottom-up (coherence) and top-down (attention) effects in AV object formation.SIGNIFICANCE STATEMENT Temporal coherence between auditory stimuli and task-irrelevant visual stimuli can enhance behavioral performance in auditory selective attention tasks. However, how audiovisual temporal coherence and attention interact at the neural level has not been established. Here, we measured EEG during a behavioral task designed to independently manipulate audiovisual coherence and auditory selective attention. While some auditory features (sound envelope) could be coherent with visual stimuli, other features (timbre) were independent of visual stimuli. We find that audiovisual integration can be observed independently of attention for sound envelopes temporally coherent with visual stimuli, while the neural responses to unexpected timbre changes are most strongly modulated by attention. Our results provide evidence for dissociable neural mechanisms of bottom-up (coherence) and top-down (attention) effects on audiovisual object formation.

Does selective attention influence the brain-stem auditory evoked potential?

Selective attention and brainstem frequency-following responses

Interaction of Self-Regulation and Contextual Effects on Pre-attentive Auditory Processing: A Combined EEG/ECG Study

Investigating the attentional effect and stimulus selectivity at the brainstem during auditory selective attention to dichotically presented /ba/ and /da/ stimuli

Selective Attention Modulates Human Auditory Brainstem Responses: Relative Contributions of Frequency and Spatial Cues

Fifty Years After: The N1 Effect Travels Down to the Brainstem

Effect of sustained selective attention on steady-state visual evoked potentials

Early Auditory Evoked Potential Is Modulated by Selective Attention and Related to Individual Differences in Visual Working Memory Capacity

Are you listening? Brain activation associated with sustained nonspatial auditory attention in the presence and absence of stimulation

Hierarchical effects of choice-related activity and neural encoding during feature selective attention

Supramodal selective attention differentially adjusts frequency and phase of entrained oscillations in primary sensory areas and the dorsal attention network

Attentional inhibition ability predicts neural representation during challenging auditory streaming

Modulating auditory selective attention by non‐invasive brain stimulation: Differential effects of transcutaneous vagal nerve stimulation and transcranial random noise stimulation

Gamma-Band Auditory Steady-State Response and Attention: A Systemic Review

Choice-related activity and neural encoding in primary auditory cortex and lateral belt during feature-selective attention

Decoding of selective attention to continuous speech from the human auditory brainstem response

Dissociable Neural Correlates of Multisensory Coherence and Selective Attention

Auditory attention measured by EEG in neurological populations: systematic review of literature and meta-analysis

Selective attention sharpens population receptive fields in human auditory cortex

The role of brain-localized gamma and alpha oscillations in inattentional deafness: implications for understanding human attention

The Effect of Visuospatial Attentional Load on the Processing of Irrelevant Acoustic Distractors