Abstract:Introduction: Recent studies have found that the sound-induced alleviation of visual attentional blink, a well-known phenomenon exemplifying the beneficial influence of multisensory integration on time-based attention, was larger when that sound was semantically congruent relative to incongruent with the second visual target (T2). Although such an audiovisual congruency effect has been attributed mainly to the semantic conflict carried by the incongruent sound restraining that sound from facilitating T2 processing, it is still unclear whether the integrated semantic information carried by the congruent sound benefits T2 processing. Methods: To dissociate the congruence-induced benefit and incongruence-induced reduction in the alleviation of visual attentional blink at the behavioral and neural levels, the present study combined behavioral measures and event-related potential (ERP) recordings in a visual attentional blink task wherein the T2-accompanying sound, when delivered, could be semantically neutral in addition to congruent or incongruent with respect to T2. Results: The behavioral data clearly showed that compared to the neutral sound, the congruent sound improved T2 discrimination during the blink to a higher degree while the incongruent sound improved it to a lesser degree. The T2-locked ERP data revealed that the early occipital cross-modal N195 component (192-228 ms after T2 onset) was uniquely larger in the congruent-sound condition than in the neutral-sound and incongruent-sound conditions, whereas the late parietal cross-modal N440 component (400-500 ms) was prominent only in the incongruent-sound condition. Discussion: These findings provide strong evidence that the modulating effect of audiovisual semantic congruency on the sound-induced alleviation of visual attentional blink contains not only a late incongruence-induced cost but also an early congruence-induced benefit, thereby demonstrating for the first time an unequivocal congruent-sound-induced benefit in alleviating the limitation of time-based visual attention.

Neural Basis of Semantically Dependent and Independent Cross-Modal Boosts on the Attentional Blink

The interplay between audiovisual temporal synchrony and semantic congruency in the cross-modal boost of the visual target discrimination during the attentional blink

Cross-modal Enhancement of Spatially Unpredictable Visual Target Discrimination During the Attentional Blink

The dissociation of semantically congruent and incongruent cross-modal effects on the visual attentional blink

The Time Course Of Spatial And Semantic Processing Between Audition And Vision: Evidence From Event-Related Potentials

Spatial and Semantic Processing Between Audition and Vision: an Event-Related Potential Study

Effect of Target Semantic Consistency in Different Sequence Positions and Processing Modes on T2 Recognition: Integration and Suppression Based on Cross-Modal Processing

Cross-Modal Selective Attention to Visual and Auditory Stimuli Modulates Endogenous Erp Components

The Attentional Blink Between Two Color Processing Tasks

Distinct neural bases of subcomponents of the attentional blink

Modal-based Attention Modulates Attentional Blink

Neural mechanisms of intermodal sustained selective attention with concurrently presented auditory and visual stimuli

Cross-modal Orienting of Visual Attention.

Effects Of Cross-Modal Selective Attention On Early Negative Difference Of Event-Related Potentials

Neural dynamics of the attentional blink revealed by encoding orientation selectivity during rapid visual presentation

Decoding Attention Control and Selection in Visual Spatial Attention

A modified oddball paradigm “cross-modal delayed response” and the research on mismatch negativity

Neural Correlates of Within-Level and Across-Level Attention to Multiple Compound Stimuli

Audiovisual Emotional Congruency Modulates the Stimulus-Driven Cross-Modal Spread of Attention.

Neural Mechanisms of Shifts of Spatial Attention Induced by Object Words with Spatial Associations: an Erp Study

The Neural Basis of Attentional Blink as a Selective Control Mechanism in Conscious Perception