Abstract:Auditory dominance refers to that auditory information competes for preferential access to consciousness in multisensory integration. Sound-induced flash illusion is an auditory dominance phenomenon in multisensory integration, which is the perception of brief visual stimuli could be qualitatively altered by concurrent brief sounds. It has been well documented that sound-induced flash illusion reflects cross-modal interactions at a perceptual level, and the illusion is too robust to change in many stimulus parameters. It remains unknown how modal-based attention influences the multisensory integration. Prior studies mostly asked participants to focus on the visual modal and ignore the auditory modal, however, in present study, we not only manipulated the modal-based attention (selective attention vs. divided attention) to ask the participants to focus their attention either on the visual modal or the auditory modal, but also manipulated task difficulty (high vs. low) to investigate how the cognitive control influences the sound-induced flash illusion. The present study was a 2 (modal-based attention: selective attention vs. divided attention) × 2 (flash number:1 vs. 2) × 3 (sound number: 0 vs. 1 vs. 2) factorial design in the two experiments, the factor of modal-based attention was manipulated by block. In experiment 1, asking the participants to judge the number of flashes first, then judge the number of sounds. In experiment 2, we increased the task difficulty, asking the participants to judge the numbers of flashes first, then judge whether the number of flash and sound were consistent. In present study, we mainly focused on the fission illusion (when a single brief visual flash is accompanied by two auditory bleeps and perceived incorrectly as two flashes) and the fusion illusion (where a double flash is accompanied by a single bleep and perceived incorrectly as a single flash). From the results of accuracy (ACC), showing that fission illusion was larger than fusion illusion, and when the participants were initiative to pay attention to the auditory modal, resulting to enlarge the fission illusion, while it did not influence the fusion illusion. From the results of reaction times (RTs), regardless of the participants were focused attention on auditory stimuli passively or paid attention to auditory stimuli initiatively, fission illusion was stable, and was not affected by the attentional resources. However, the fusion illusion was not reflected in the reaction times. Together with the experiment 1and 2, we also suggested that the task difficulty could not influence the sound-induced flash illusion. The results indicated that regardless of the single modal-based attention or the cross modal-based attention, compared with the fusion illusion, the fission illusion was larger, and was more affected by the distribution of attentional resources. In addition, we also indicated that task difficulty could influence the sound-induced flash illusion.

Modality matters: Three auditory conflict tasks to measure individual differences in attention control

Nature and measurement of attention control.

A New Test of Attention in Listening (tail) Predicts Auditory Performance

Modality-specific impacts of distractors on visual and auditory categorical decision-making: an evidence accumulation perspective

Sensory Dominance Depends on Locus of Attentional Selection: Cross-Modal Distraction at Different Levels of Information Processing

Effect of Selective and Divided Attentions on Auditory Dominance in Multisensory Integration

Dissociable Neural Correlates of Multisensory Coherence and Selective Attention

Dissociated roles of the parietal and frontal cortices in the scope and control of attention during visual working memory.

Attentional control and metacognitive monitoring of the effects of different types of task-irrelevant sound on serial recall.

Is Attentional Resource Allocation Across Sensory Modalities Task-Dependent?

Dichotic and dichoptic digit perception in normal adults

Auditory, Lexical, and Multitasking Demands Interactively Impact Listening Effort

The Effect of Visuospatial Attentional Load on the Processing of Irrelevant Acoustic Distractors

The Effects of Bilateral and Ipsilateral Auditory Stimuli on the Subcomponents of Visual Attention

An Exploration of the Effects of Cross-Modal Tasks on Selective Attention

Behavioral measures of attention and cognitive control during a new auditory working memory paradigm

Separate attentional resources for vision and audition

Early Auditory Evoked Potential Is Modulated by Selective Attention and Related to Individual Differences in Visual Working Memory Capacity

Divided Attention in Perception: A Unified Analysis of Dual-Task Deficits and Congruency Effects

Inattentional deafness to auditory alarms: Inter-individual differences, electrophysiological signature and single trial classification

Vision Dominates At The Preresponse Level And Audition Dominates At The Response Level In Cross-Modal Interaction: Behavioral And Neural Evidence