Abstract:Interacting with the environment often requires the integration of visual and haptic information. Notably, perceiving external objects depends on how our brain binds sensory inputs into a unitary experience. The feedback provided by objects when we interact (through our movements) with them might then influence our perception. In VR, the interaction with an object can be dissociated by the size of the object itself by means of 'colliders' (interactive spaces surrounding the objects). The present study investigates possible after-effects in size discrimination for virtual objects after exposure to a prolonged interaction characterized by visual and haptic incongruencies. A total of 96 participants participated in this virtual reality study. Participants were distributed into four groups, in which they were required to perform a size discrimination task between two cubes before and after 15 min of a visuomotor task involving the interaction with the same virtual cubes. Each group interacted with a different cube where the visual (normal vs. small collider) and the virtual cube's haptic (vibration vs. no vibration) features were manipulated. The quality of interaction (number of touches and trials performed) was used as a dependent variable to investigate the performance in the visuomotor task. To measure bias in size perception, we compared changes in point of subjective equality (PSE) before and after the task in the four groups. The results showed that a small visual collider decreased manipulation performance, regardless of the presence or not of the haptic signal. However, change in PSE was found only in the group exposed to the small visual collider with haptic feedback, leading to increased perception of the cube size. This after-effect was absent in the only visual incongruency condition, suggesting that haptic information and multisensory integration played a crucial role in inducing perceptual changes. The results are discussed considering the recent findings in visual-haptic integration during multisensory information processing in real and virtual environments.

The Effectiveness of Multimodal Sensory Feedback on VR Users’ Behavior in an L-Collision Problem

Effects of Sensory Feedback and Collider Size on Reach-to-Grasp Coordination in Haptic-Free Virtual Reality

Multimodal Interfaces for Effective Teleoperation

The effects of substitute multisensory feedback on task performance and the sense of presence in a virtual reality environment

Investigating the Effect of Sensory Concurrency on Learning Haptic Spatiotemporal Signals

Multimodal Feedback to Improve Performance of Order Picker Truck Drivers Using a Virtual Reality Simulator

On the Use of Multi-sensory Cues in Symmetric and Asymmetric Shared Collaborative Virtual Spaces

Impact of Multimodal Feedback on Simulated Ergonomic Measurements in a Virtual Environment: A Case Study with Manufacturing Workers

Exploring the Role of Expected Collision Feedback in Crowded Virtual Environments

Effects of Multisensory Feedback on the Perception and Performance of Virtual Reality Hand-Retargeted Interaction

Exploring virtual reality object perception following sensory-motor interactions with different visuo-haptic collider properties

Concurrent Crossmodal Feedback Assists Target-searching: Displaying Distance Information Through Visual, Auditory and Haptic Modalities

Feeling Senseless Sensations: A Crossmodal study of mismatching tactile and virtual visual experience

Evaluating the efficacy of haptic feedback, 360° treadmill-integrated Virtual Reality framework and longitudinal training on decision-making performance in a complex search-and-shoot simulation

Using Multimodal Interaction in a Virtual Reality Thoracic Diagnostic Scenario

Multimodal Feedback Methods for Advancing the Accessibility of Immersive Virtual Reality for People With Balance Impairments Due to Multiple Sclerosis

Point and Select: Effects of Multimodal Feedback on Text Entry Performance in Virtual Reality

The Effect of Audiovisual Spatial Design on User Experience of Bare-Hand Interaction in VR

Multimodal Haptic Feedback for Virtual Collisions Combining Vibrotactile and Electrical Muscle Stimulation

The Differential Effects of Multisensory Attentional Cues on Task Performance in VR Depending on the Level of Cognitive Load and Cognitive Capacity

Aircraft Cockpit Interaction in Virtual Reality with Visual, Auditive, and Vibrotactile Feedback