Abstract:The rubber hand illusion describes a phenomenon in which participants experience a rubber hand as being part of their body by the synchronous application of visuotactile stimulation to the real and the artificial limb. In the recently introduced robotic hand illusion (RobHI), a robotic hand is incorporated into one's body representation due to the integration of synchronous visuomotor information. However, there are no setups so far that combine visuotactile and visuomotor feedback, which is expected to unravel mechanisms that cannot be detected in experimental designs applying this information in isolation. We developed a robotic hand, controlled by a sensor glove and equipped with pressure sensors, and varied systematically and separately the synchrony for motor feedback (MF) and tactile feedback (TF). In Experiment 1, we implemented a ball-grasping task and assessed the perceived proprioceptive drift of one's own hand as a behavioral measure of the spatial calibration of body coordinates as well as explicit embodiment experiences by a questionnaire. Results revealed significant main effects of both MF and TF for proprioceptive drift data, but we only observed main effects for MF on perceived embodiment. Furthermore, for the proprioceptive drift we found that synchronous feedback in one factor compensates for asynchronous feedback in the other. In Experiment 2, including a new sample of naïve participants, we further explored this finding by adding unimodal conditions, in which we manipulated the presence or absence of MF and/or TF. These findings replicated the results from Experiment 1 and we further found evidence for a supper-additive multisensory effect on spatial body representation caused by the presence of both factors. Results on conscious body perception were less consistent across both experiments. The findings indicate that sensory and motor input equally contribute to the representation of spatial body coordinates which for their part are subject to multisensory enhancing effects. The results outline the potential of human-in-the-loop approaches and might have important implications for clinical applications such as for the future design of robotic prostheses.

Effect of visual and tactile feedback on kinematic synergies in the grasping hand

Adaptive Grasping of the Soft Prosthetic Hand Via Tactile Feedback

Closed-Loop Force Control by Biorealistic Hand Prosthesis With Visual and Tactile Sensory Feedback

Modelling natural and artificial hands with synergies

Reconstructing Synergy-Based Hand Grasp Kinematics from Electroencephalographic Signals

Effect of Visual Feedback on Behavioral Control and Functional Activity During Bilateral Hand Movement

Effects of Different Tactile Feedback on Myoelectric Closed-Loop Control for Grasping Based on Electrotactile Stimulation.

Neural Synergies for Controlling Reach and Grasp Movement in Macaques.

Multichannel electrotactile feedback for simultaneous and proportional myoelectric control

Hierarchical and synergistic organization of control variables during the multi-digit grasp of a free and an externally fixed object

Force Feedback Control For Dexterous Robotic Hands Using Conditional Postural Synergies

Visual Feedback Gain Modulates the Activation of Task-Related Networks and the Suppression of Non-Task Networks During Precise Grasping

Haptic Shared Control Improves Neural Efficiency During Myoelectric Prosthesis Use

Sensorimotor-inspired Tactile Feedback and Control Improve Consistency of Prosthesis Manipulation in the Absence of Direct Vision

Investigation of adaptive muscle synergy modulated motor responses to grasping perturbations

Experimental Evaluation of a Hybrid Sensory Feedback System for Haptic and Kinaesthetic Perception in Hand Prostheses

Sensory synergy as environmental input integration

Robotic hand illusion with tactile feedback: Unravelling the relative contribution of visuotactile and visuomotor input to the representation of body parts in space

The impact of objective functions on control policies in closed-loop control of grasping force with a myoelectric prosthesis

Understanding Grasp Synergies during Reach-to-grasp using an Instrumented Data Glove

Evaluation of Postural Muscle Synergies during a Complex Motor Task in a Virtual Reality Environment