Abstract:The role of attention in speech comprehension is not well understood. We used fMRI to study the neural correlates of auditory word, pseudoword, and nonspeech (spectrally rotated speech) perception during a bimodal (auditory, visual) selective attention task. In three conditions, Attend Auditory (ignore visual), Ignore Auditory (attend visual), and Visual (no auditory stimulation), 28 subjects performed a one-back matching task in the assigned attended modality. The visual task, attending to rapidly presented Japanese characters, was designed to be highly demanding in order to prevent attention to the simultaneously presented auditory stimuli. Regardless of stimulus type, attention to the auditory channel enhanced activation by the auditory stimuli (Attend Auditory>Ignore Auditory) in bilateral posterior superior temporal regions and left inferior frontal cortex. Across attentional conditions, there were main effects of speech processing (word+pseudoword>rotated speech) in left orbitofrontal cortex and several posterior right hemisphere regions, though these areas also showed strong interactions with attention (larger speech effects in the Attend Auditory than in the Ignore Auditory condition) and no significant speech effects in the Ignore Auditory condition. Several other regions, including the postcentral gyri, left supramarginal gyrus, and temporal lobes bilaterally, showed similar interactions due to the presence of speech effects only in the Attend Auditory condition. Main effects of lexicality (word>pseudoword) were isolated to a small region of the left lateral prefrontal cortex. Examination of this region showed significant word>pseudoword activation only in the Attend Auditory condition. Several other brain regions, including left ventromedial frontal lobe, left dorsal prefrontal cortex, and left middle temporal gyrus, showed Attention x Lexicality interactions due to the presence of lexical activation only in the Attend Auditory condition. These results support a model in which neutral speech presented in an unattended sensory channel undergoes relatively little processing beyond the early perceptual level. Specifically, processing of phonetic and lexical-semantic information appears to be very limited in such circumstances, consistent with prior behavioral studies.

Auditory Target Detection Enhances Visual Processing and Hippocampal Functional Connectivity

Attention Modulates the Auditory Cortical Processing of Spatial and Category Cues in Naturalistic Auditory Scenes

Target Detection Modulates EEG Spectral Correlates of Successful Memory Encoding

Sounds activate visual cortex and improve visual discrimination.

Supramodal selective attention differentially adjusts frequency and phase of entrained oscillations in primary sensory areas and the dorsal attention network

Dynamic oscillatory processes governing cued orienting and allocation of auditory attention

Selective attention sharpens population receptive fields in human auditory cortex

Hierarchical effects of choice-related activity and neural encoding during feature selective attention

Attention enhances category representations across the brain with strengthened residual correlations to ventral temporal cortex

Congruent Audiovisual Speech Enhances Cortical Envelope Tracking During Auditory Selective Attention.

Selective attention to audiovisual speech routes activity through recurrent feedback-feedforward loops between different nodes of the speech network

Dissociable Neural Correlates of Multisensory Coherence and Selective Attention

Classification of Targets and Distractors in an Audiovisual Attention Task Based on Electroencephalography

Attention to audiovisual speech shapes neural processing through feedback-feedforward loops between different nodes of the speech network

Attentional and linguistic interactions in speech perception

Temporal attention amplifies stimulus information in fronto-cingulate cortex at an intermediate processing stage

Attention Drives Visual Processing and Audiovisual Integration During Multimodal Communication

Selective attention to sound features mediates cross-modal activation of visual cortices

Auditory change detection and visual selective attention: association between MMN and N2pc

Involuntary Orienting of Attention to a Sound Desynchronizes the Occipital Alpha Rhythm and Improves Visual Perception

Selective auditory attention within naturalistic scenes modulates reactivity to speech sounds