Abstract:Real-world listening settings often consist of multiple concurrent sound streams. To limit perceptual interference during selective listening, the auditory system segregates and filters the relevant sensory input. Previous work provided evidence that auditory cortex is critically involved in this process, and selectively gates attended input towards subsequent processing stages. We studied at which level of auditory cortex processing this filtering of attended information occurs using functional magnetic resonance imaging (fMRI) and a naturalistic selective listening task. Forty-five human listeners (of either sex) attended to one of two continuous speech streams, presented either concurrently or in isolation. Functional data were analyzed using an inter-subject analysis to assess stimulus-specific components of ongoing auditory cortex activity. Our results suggest that stimulus-related activity in primary auditory cortex and the adjacent planum temporale are hardly affected by attention, whereas brain responses at higher stages of the auditory cortex processing hierarchy become progressively more selective for the attended input. Consistent with these findings, a complementary analysis of stimulus-driven functional connectivity further demonstrated that information on the to-be-ignored speech stream is shared between primary auditory cortex and the planum temporale, but largely fails to reach higher processing stages. Our findings suggest that the neural processing of ignored speech cannot be effectively suppressed at the level of early cortical processing of acoustic features, but is gradually attenuated once the competing speech streams are fully segregated. Significance statement When listening selectively to one of multiple speech streams, the attended stream is segregated from the acoustic mixture and gated to further information processing, whereas the processing of irrelevant speech must be attenuated to minimize distraction. We here used functional magnetic resonance imaging to investigate the role of auditory cortex for this attentional filtering of auditory input. Our data suggest that stimulus representations in primary auditory cortex and the planum temporale are hardly affected by attention, whereas responses further along the auditory cortex processing hierarchy get more and more selective for the attended input. This suggests that ignored speech cannot be effectively suppressed on the acoustic feature level but is gradually attenuated once the competing speech streams are fully segregated.

Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading

Mechanisms Underlying Selective Neuronal Tracking of Attended Speech at a “cocktail Party”

Spatial alignment between faces and voices improves selective attention to audio-visual speech

Attentional and linguistic interactions in speech perception

Attention Drives Visual Processing and Audiovisual Integration During Multimodal Communication

Attention-Driven Modulation of Auditory Cortex Activity during Selective Listening in a Multispeaker Setting

Selective attention to sound features mediates cross-modal activation of visual cortices

Cross-modal Enhancement of Spatially Unpredictable Visual Target Discrimination During the Attentional Blink

Congruent Audiovisual Speech Enhances Cortical Envelope Tracking During Auditory Selective Attention.

Attention-driven modulation of auditory cortex activity during selective listening in a multi-speaker setting

Selective auditory attention within naturalistic scenes modulates reactivity to speech sounds

Capturing Visual Attention With Perturbed Auditory Spatial Cues

A further examination of attentional effects in the phonemic restoration illusion

Concurrent talking in immersive virtual reality: on the dominance of visual speech cues

Selective attention to audiovisual speech routes activity through recurrent feedback-feedforward loops between different nodes of the speech network

Cross-modal Orienting of Visual Attention.

Attention to audiovisual speech shapes neural processing through feedback-feedforward loops between different nodes of the speech network

Neural Mechanisms Underlying Cross-Modal Phonetic Encoding

Virtually spatialized sounds enhance auditory processing in healthy participants and patients with a disorder of consciousness

Attention Modulates the Auditory Cortical Processing of Spatial and Category Cues in Naturalistic Auditory Scenes

Right hemisphere dominance for auditory attention and its modulation by eye position: An event related fMRI study