Abstract:In our everyday lives, we need to process auditory and visual temporal information as efficiently as possible. Although automatic auditory time perception has been widely investigated using an index of the mismatch negativity (MMN), the neural basis of automatic visual time perception has been largely ignored. The present study investigated the automatic processing of auditory and visual time perception employing the cross-modal delayed response oddball paradigm. In the experimental condition, the standard stimulus was 200ms and the deviant stimulus was 120ms, which were exchanged in the control condition. Reaction time, accuracy, and event-related potential (ERP) data were measured when participants performed the duration discrimination task. The ERP results showed that the MMN, N2b, and P3 were elicited by an auditory deviant stimulus under the attention condition, while only the MMN was elicited under the inattention condition. The MMN was largest over the frontal and central sites, while the difference in MMN amplitude was not significant between under the attention and inattention condition. In contrast, the change-related positivity (CRP) and the visual mismatch negativity (vMMN) were elicited by the visual deviant stimulus under both the attention and inattention conditions. The CRP was largest over the occipito-temporal sites under the attention condition and over the fronto-central sites under the inattention condition. The difference in CRP amplitude was significant between the attention and inattention condition. The vMMN was largest over the parieto-occipital sites under the attention condition, and largest over the fronto-central sites under the inattention condition. The difference in vMMN amplitude was significant between the attention and inattention condition. Auditory MMN does not appear to be modulated by attention, whereas the visual CRP and the vMMN are modulated by attention. Therefore, the present study provides electrophysiological evidence for the existence of automatic visual time perception and supports an “attentional switch” hypothesis for a modality effect on duration judgments, such that auditory temporal information is processed relatively automatically, whereas visual temporal information processing requires controlled attention.

Onset timing of letter processing in auditory and visual sensory cortices

Crossmodal visual predictions elicit spatially specific early visual cortex activity but later than real visual stimuli

Multisensory representations of space and time in sensory cortices

Disparity of Activation Onset in Sensory Cortex from Simultaneous Auditory and Visual Stimulation: Differences Between Perfusion and Blood Oxygenation Level‐dependent Functional Magnetic Resonance Imaging

Early Cortical Connective Network Relating To Audiovisual Stimulation By Partial Directed Coherence Analysis

Triple dissociation of visual, auditory and motor processing in mouse primary visual cortex

Selective attention to sound features mediates cross-modal activation of visual cortices

Cortical Oscillations In Auditory Perception And Speech: Evidence For Two Temporal Windows In Human Auditory Cortex

Cross-modal Representations in Early Visual and Auditory Cortices Revealed by Multi-Voxel Pattern Analysis.

Laminar organization of visual responses in core and parabelt auditory cortex

Combined diffusion-weighted and functional magnetic resonance imaging reveals a temporal-occipital network involved in auditory-visual object processing

Multisensory-Guided Associative Learning Enhances Multisensory Representation in Primary Auditory Cortex.

Neural Correlates of Temporal Complexity and Synchrony During Audiovisual Correspondence Detection

Lipreading and covert speech production similarly modulate human auditory-cortex responses to pure tones

Auditory stimuli extend the temporal window of visual integration by modulating alpha-band oscillations

Cross-modal interaction of Alpha Activity does not reflect inhibition of early sensory processing: A frequency tagging study using EEG and MEG

Locating the Sources for Cross-Modal Interactions and Decision Making During Judging the Visual-Affected Auditory Intensity Change.

Retinotopic effects during spatial audio-visual integration

Multisensory Interplay Within Human Auditory Cortex: New Evidence from Intraoperative Optical Imaging of Intrinsic Signal.

Spatiotemporal Mapping of Auditory Onsets during Speech Production

Differences in the Neural Basis of Automatic Auditory and Visual Time Perception: ERP Evidence from an Across-Modal Delayed Response Oddball Task