Abstract:The role of attention in speech comprehension is not well understood. We used fMRI to study the neural correlates of auditory word, pseudoword, and nonspeech (spectrally rotated speech) perception during a bimodal (auditory, visual) selective attention task. In three conditions, Attend Auditory (ignore visual), Ignore Auditory (attend visual), and Visual (no auditory stimulation), 28 subjects performed a one-back matching task in the assigned attended modality. The visual task, attending to rapidly presented Japanese characters, was designed to be highly demanding in order to prevent attention to the simultaneously presented auditory stimuli. Regardless of stimulus type, attention to the auditory channel enhanced activation by the auditory stimuli (Attend Auditory>Ignore Auditory) in bilateral posterior superior temporal regions and left inferior frontal cortex. Across attentional conditions, there were main effects of speech processing (word+pseudoword>rotated speech) in left orbitofrontal cortex and several posterior right hemisphere regions, though these areas also showed strong interactions with attention (larger speech effects in the Attend Auditory than in the Ignore Auditory condition) and no significant speech effects in the Ignore Auditory condition. Several other regions, including the postcentral gyri, left supramarginal gyrus, and temporal lobes bilaterally, showed similar interactions due to the presence of speech effects only in the Attend Auditory condition. Main effects of lexicality (word>pseudoword) were isolated to a small region of the left lateral prefrontal cortex. Examination of this region showed significant word>pseudoword activation only in the Attend Auditory condition. Several other brain regions, including left ventromedial frontal lobe, left dorsal prefrontal cortex, and left middle temporal gyrus, showed Attention x Lexicality interactions due to the presence of lexical activation only in the Attend Auditory condition. These results support a model in which neutral speech presented in an unattended sensory channel undergoes relatively little processing beyond the early perceptual level. Specifically, processing of phonetic and lexical-semantic information appears to be very limited in such circumstances, consistent with prior behavioral studies.

Sound source location modulates the irrelevant-sound effect

Source Information is Inherently Linked to Working Memory Representation for Auditory but Not for Visual Stimuli

Attentional control and metacognitive monitoring of the effects of different types of task-irrelevant sound on serial recall.

Auditory objects in working memory include task-irrelevant features

Front-back asymmetries in endogenous auditory spatial attention

Distraction by deviant sounds during reading: An eye-movement study

Do Irrelevant Sounds Impair the Maintenance of All Characteristics of Speech in Memory?

Distraction by Auditory Categorical Deviations Is Unrelated to Working Memory Capacity: Further Evidence of a Distinction between Acoustic and Categorical Deviation Effects

The surprising robustness of visual search against concurrent auditory distraction.

Shared cognitive resources between memory and attention during sound-sequence encoding

The Effect of Visuospatial Attentional Load on the Processing of Irrelevant Acoustic Distractors

Spatial attention modulates auditory dominance in audiovisual order judgment.

False memories through auditory distraction: When irrelevant speech produces memory intrusions in the absence of semantic interference

Selective attention to sound features mediates cross-modal activation of visual cortices

Selective Attention Modulates Human Auditory Brainstem Responses: Relative Contributions of Frequency and Spatial Cues

Tracking the Misallocation and Reallocation of Spatial Attention toward Auditory Stimuli

Attentional and linguistic interactions in speech perception

Relative Effectiveness of Three Stimulus Variables for Locating a Moving Sound Source

Modality-specific impacts of distractors on visual and auditory categorical decision-making: an evidence accumulation perspective

Involuntary Orienting of Attention to a Sound Desynchronizes the Occipital Alpha Rhythm and Improves Visual Perception

Right hemisphere dominance for auditory attention and its modulation by eye position: An event related fMRI study