Abstract:In the study of bodily-awareness, the Predictive Coding Theory has revealed that our brain continuously modulates sensory experiences to integrate them into a unitary body representation. Indeed, during multisensory illusions (e.g., the rubber hand illusion; RHI), the synchronous stroking of the participant's concealed hand and a fake visible one creates a visuo-tactile conflict, generating a prediction error. Within the Predictive Coding framework, through sensory processing modulation, prediction errors are solved, inducing participants to feel as if touches originated from the fake hand, thus ascribing the fake hand to their own body. Here, we aimed to address sensory processing modulation under multisensory conflict, by disentangling somatosensory and visual stimuli processing, that are intrinsically associated during the illusion induction. To this aim, we designed two EEG experiments, in which somatosensory (SEPs; Experiment 1; N=18, F=10) and visual-evoked potentials (VEPs; Experiment 2; N=18; F=9) were recorded in human males and females following the RHI. Our results show that, in both experiments, ERP amplitude is significantly modulated in the illusion as compared to both control and baseline conditions, with a modality-dependent diametrical pattern showing decreased SEP amplitude and increased VEP amplitude. Importantly, both somatosensory and visual modulations occur in long-latency time windows previously associated with tactile and visual awareness, thus explaining the illusion of perceiving touch at the sight location. In conclusion, we describe a diametrical modulation of somatosensory and visual processing as the neural mechanism that allows to maintain a stable body representation, by restoring visuo-tactile congruency under the occurrence of multisensory conflicts. Significance statement Given the inherent relationship between touch and body, the literature on body representation has mainly focused on the somatosensory system's investigation, whereas less attention has been paid to the visual system. Here, we aim to investigate the modulation of both somatosensory and visual processing during a well-known multisensory illusion (i.e., the rubber hand illusion; RHI), in which visuo-tactile conflict is employed to challenge body representation. By recording electroencephalography, we show how the processing of somatosensory and visual stimuli is diametrically modulated during the RHI, with a decrease of the former and an increase of the latter. We conclude that this neural mechanism is triggered to restore visuo-tactile congruency, leading to the illusory feeling of perceiving touch at the sight location.

The Simon effect under reversed visual feedback

The Virtual Hand Illusion is Moderated by Context-Induced Spatial Reference Frames.

The Roles of Attentional Shifts and Attentional Reengagement in Resolving the Spatial Compatibility Effect in Tactile Simon-like Tasks

Why Do Things Seem Closer Than They Are?

Action effect consistency and body ownership in the avatar-Simon task

Spatial tactile localization depends on sensorimotor binding: preliminary evidence from virtual reality

Practice effects vs. transfer effects in the Simon task

The timing of stimulus localisation and the Simon effect: an ERP study

From eyes to hands: Transfer of learning in the Simon task across motor effectors

Identifying spatial effects in a lateralized duration estimation task

Separate timescales for spatial and anatomical information processing during action observation

Visual perspective taking for avatars in a Simon task

Balancing the senses: electrophysiological responses reveal the interplay between somatosensory and visual processing during body-related multisensory conflict

Individual differences in the Simon effect are underpinned by differences in the competitive dynamics in the basal ganglia: An experimental verification and a computational model

Changing motor perception by sensorimotor conflicts and body ownership

Perceptual target discriminability modulates the Simon effect beyond the fading of distractor-based activation: Insights from delta plots and diffusion model analyses.

Decoding the physics of observed actions in the human brain

Visuomotor Adaptation and Sensory Recalibration in Reversed Hand Movement Task.

Anticipated affective action-effects as controlling factors of spatially oriented pointing movement

Investigating the nature of spatial codes for different modes of Simon tasks: Evidence from congruency sequence effects and delta functions.

Influence of Simple Action on Subsequent Manual and Ocular Responses