Abstract:Mismatch responses to tri‐modal roving stimulus sequences revealed a fronto‐parietal network of expectation violation shared across audition, somatosensation and vision. The intraparietal network hub showed specific sensitivity for cross‐modal predictability of stimulus transitions embedded in the multi‐modal sequence configuration. The brain is subjected to multi‐modal sensory information in an environment governed by statistical dependencies. Mismatch responses (MMRs), classically recorded with EEG, have provided valuable insights into the brain's processing of regularities and the generation of corresponding sensory predictions. Only few studies allow for comparisons of MMRs across multiple modalities in a simultaneous sensory stream and their corresponding cross‐modal context sensitivity remains unknown. Here, we used a tri‐modal version of the roving stimulus paradigm in fMRI to elicit MMRs in the auditory, somatosensory and visual modality. Participants (N = 29) were simultaneously presented with sequences of low and high intensity stimuli in each of the three senses while actively observing the tri‐modal input stream and occasionally reporting the intensity of the previous stimulus in a prompted modality. The sequences were based on a probabilistic model, defining transition probabilities such that, for each modality, stimuli were more likely to repeat (p = .825) than change (p = .175) and stimulus intensities were equiprobable (p = .5). Moreover, each transition was conditional on the configuration of the other two modalities comprising global (cross‐modal) predictive properties of the sequences. We identified a shared mismatch network of modality general inferior frontal and temporo‐parietal areas as well as sensory areas, where the connectivity (psychophysiological interaction) between these regions was modulated during mismatch processing. Further, we found deviant responses within the network to be modulated by local stimulus repetition, which suggests highly comparable processing of expectation violation across modalities. Moreover, hierarchically higher regions of the mismatch network in the temporo‐parietal area around the intraparietal sulcus were identified to signal cross‐modal expectation violation. With the consistency of MMRs across audition, somatosensation and vision, our study provides insights into a shared cortical network of uni‐ and multi‐modal expectation violation in response to sequence regularities.

Single-Trial EEG-fMRI Reveals the Generation Process of the Mismatch Negativity

Dissecting Mismatch Negativity: Early and Late Subcomponents for Detecting Deviants in Local and Global Sequence Regularities

The Mismatch Negativity: an Indicator of Perception of Regularities in Music

Cortical Areas Associated with Mismatch Negativity: A Connectivity Study Using Propofol Anesthesia

Tracking the mismatch information in visual short term memory: an event-related potential study.

Rubberband Effect in Temporal Control of Mismatch Negativity

From the Laboratory to the Real-World: The Role of Mismatch Negativity in Psychosis

Empirical Mode Decomposition On Mismatch Negativity

Extraction of Mismatch Negativity Using A Resampling-Based Spatial Filtering Method

Adaptation patterns and their associations with mismatch negativity: An electroencephalogram (EEG) study with controlled expectations

A multimodal cortical network of sensory expectation violation revealed by fMRI

Study of Visual Mismatch Negativity Based on Cross-Modal Experimental Pattern

Mismatch Negativity: time for deconstruction

A Magnetoencephalographic Study of Face Processing: M170, Gamma‐band Oscillations and Source Localization

Cortical Generators and Connections Underlying Phoneme Perception: A Mismatch Negativity and P300 Investigation

Development of Biomarkers Potentially Sensitive to Early Psychosis Using Mismatch Negativity (MMN) to Complex Pattern Deviations

The Lateralization and Reliability of Spatial Mismatch Negativity Elicited by Auditory Deviants with Virtual Spatial Location

Controlled study of mismatched negativity in first-episode deficit and non-deficit forms schizophrenia patients who not received treatment

Leveraging Mixed-Effects Location Scale Models to Assess the ERP Mismatch Negativity's Psychometric Properties and Trial-by-Trial Neural Variability in Toddler-Mother Dyads

Scanning the World in Three Seconds: Mismatch Negativity As an Indicator of Temporal Segmentation.

The technique of multivariate empirical mode decomposition and independent component analysis to exactly extract the mismatch negativity from EEG