Abstract:ObjectivePerceptual integration and segregation are modulated by the phase of ongoing neural oscillation whose frequency period is broader than the size of the temporal binding window (TBW). Studies have shown that the abstract beep-flash stimuli with about 100 ms TBW were modulated by the alpha band phase. Therefore, we hypothesize that the temporal perception of speech with about hundreds of milliseconds of TBW might be affected by the delta-theta phase.MethodsThus, we conducted a speech-stimuli-based audiovisual simultaneity judgment (SJ) experiment. Twenty human participants (12 females) attended this study, recording 62 channels of EEG.ResultsBehavioral results showed that the visual leading TBWs are broader than the auditory leading ones [273.37 ± 24.24 ms vs. 198.05 ± 19.28 ms, (mean ± sem)]. We used Phase Opposition Sum (POS) to quantify the differences in mean phase angles and phase concentrations between synchronous and asynchronous responses. The POS results indicated that the delta-theta phase was significantly different between synchronous and asynchronous responses in the A50V condition (50% synchronous responses in auditory leading SOA). However, in the V50A condition (50% synchronous responses in visual leading SOA), we only found the delta band effect. In the two conditions, we did not find a consistency of phases over subjects for both perceptual responses by the post hoc Rayleigh test (all ps > 0.05). The Rayleigh test results suggested that the phase might not reflect the neuronal excitability which assumed that the phases within a perceptual response across subjects concentrated on the same angle but were not uniformly distributed. But V-test showed the phase difference between synchronous and asynchronous responses across subjects had a significant phase opposition (all ps < 0.05) which is compatible with the POS result.ConclusionThese results indicate that the speech temporal perception depends on the alignment of stimulus onset with an optimal phase of the neural oscillation whose frequency period might be broader than the size of TBW. The role of the oscillatory phase might be encoding the temporal information which varies across subjects rather than neuronal excitability. Given the enriched temporal structures of spoken language stimuli, the conclusion that phase encodes temporal information is plausible and valuable for future research.

The Oscillatory Activities And Its Synchronization In Auditory-Visual Integration As Revealed By Event-Related Potentials To Bimodal Stimuli

Eye Activity Tracks Task-Relevant Structures During Speech and Auditory Sequence Perception

Beyond alpha band: prestimulus local oscillation and interregional synchrony of the beta band shape the temporal perception of the audiovisual beep-flash stimulus

Neural Oscillations Reflect the Individual Differences in the Temporal Perception of Audiovisual Speech.

Differential modulations of theta and beta oscillations by audiovisual congruency in letter‐speech sound integration

Phase Synchrony Measurement of ERP Based on Complex Wavelet During Visual-Audio Multisensory Integration

Exploration of Event-Evoked Oscillatory Activities During a Cognitive Task

Characterizing the Time-Varying Brain Networks of Audiovisual Integration across Frequency Bands

EEG Gamma-Band Activity During Audiovisual Speech Comprehension in Different Noise Environments.

The Integration of Facial and Vocal Cues During Emotional Change Perception: EEG Markers.

Auditory stimuli extend the temporal window of visual integration by modulating alpha-band oscillations

Cognitive integration of asynchronous natural or non-natural auditory and visual information in videos of real-world events: an event-related potential study

The Effect of Prestimulus Low-Frequency Neural Oscillations on the Temporal Perception of Audiovisual Speech

[Phase Synchronization Analysis of EEG Signal During Audio-Visual Stimulation].

Neocortical and hippocampal theta oscillations track audiovisual integration and replay of speech memories

Revealing Spatiotemporal Brain Dynamics Of Speech Production Based On Eeg And Eye Movement

Study on synchronization of ERP evoked by simultaneous visual-audio stimuli

The Effects of Synchronous and Asynchronous Steady-State Auditory-Visual Motion on EEG Characteristics in Healthy Young Adults

The Effect of Visual Reliability on Auditory-Visual Integration: an Event-Related Potential Study

Event-related Potentials Reveal Early Visual-tactile Integration in the Deaf

Characterizing spatio-temporal brain oscillatory activities in stroop interference using an integrated method