Abstract:Due to capacity limits on perception, conditions of high perceptual load lead to reduced processing of unattended stimuli (Lavie et al., 2014). Accumulating work demonstrates the effects of visual perceptual load on visual cortex responses, but the effects on auditory processing remain poorly understood. Here we establish the neural mechanisms underlying "inattentional deafness"--the failure to perceive auditory stimuli under high visual perceptual load. Participants performed a visual search task of low (target dissimilar to nontarget items) or high (target similar to nontarget items) load. On a random subset (50%) of trials, irrelevant tones were presented concurrently with the visual stimuli. Brain activity was recorded with magnetoencephalography, and time-locked responses to the visual search array and to the incidental presence of unattended tones were assessed. High, compared to low, perceptual load led to increased early visual evoked responses (within 100 ms from onset). This was accompanied by reduced early (∼ 100 ms from tone onset) auditory evoked activity in superior temporal sulcus and posterior middle temporal gyrus. A later suppression of the P3 "awareness" response to the tones was also observed under high load. A behavioral experiment revealed reduced tone detection sensitivity under high visual load, indicating that the reduction in neural responses was indeed associated with reduced awareness of the sounds. These findings support a neural account of shared audiovisual resources, which, when depleted under load, leads to failures of sensory perception and awareness.SIGNIFICANCE STATEMENT: The present work clarifies the neural underpinning of inattentional deafness under high visual load. The findings of near-simultaneous load effects on both visual and auditory evoked responses suggest shared audiovisual processing capacity. Temporary depletion of shared capacity in perceptually demanding visual tasks leads to a momentary reduction in sensory processing of auditory stimuli, resulting in inattentional deafness. The dynamic "push-pull" pattern of load effects on visual and auditory processing furthers our understanding of both the neural mechanisms of attention and of cross-modal effects across visual and auditory processing. These results also offer an explanation for many previous failures to find cross-modal effects in experiments where the visual load effects may not have coincided directly with auditory sensory processing.

Audiovisual detection at different intensities and delays

Visual Target Detection in a Distracting Background Relies on Neural Encoding of Both Visual Targets and Background.

Effects of Signal Intervals and Dual Tasks on the Reaction Time for Detecting Signals in Visual Monitoring

Multisensory processing of redundant information in go/no-go and choice responses

Divided Attention in Perception: A Unified Analysis of Dual-Task Deficits and Congruency Effects

Tracking the Misallocation and Reallocation of Spatial Attention toward Auditory Stimuli

The interplay between audiovisual temporal synchrony and semantic congruency in the cross-modal boost of the visual target discrimination during the attentional blink

Spatiotemporal models for multisensory integration

Costs and benefits of audiovisual interactions

Semantic Incongruency Interferes with Endogenous Attention in Cross-Modal Integration of Semantically Congruent Objects

Auditory change detection and visual selective attention: association between MMN and N2pc

Cross-modal Enhancement of Spatially Unpredictable Visual Target Discrimination During the Attentional Blink

The stimulus‐driven and representation‐driven cross‐modal attentional spreading are both modulated by audiovisual temporal synchrony

What You See Depends on What You Hear: Temporal Averaging and Crossmodal Integration

Neural Correlates of Temporal Complexity and Synchrony During Audiovisual Correspondence Detection

Inattentional Deafness: Visual Load Leads to Time-Specific Suppression of Auditory Evoked Responses

Distinct Mechanism of Audiovisual Integration with Informative and Uninformative Sound in a Visual Detection Task: A DCM Study

Inattentional deafness to auditory alarms: Inter-individual differences, electrophysiological signature and single trial classification

Loss of precise auditory sampling as a sign of value-driven visual attentional capture

Effect of Target Semantic Consistency in Different Sequence Positions and Processing Modes on T2 Recognition: Integration and Suppression Based on Cross-Modal Processing

Dissociable Neural Correlates of Multisensory Coherence and Selective Attention