Abstract:In current virtual reality settings for motor skill training, only visual information is usually provided regarding the virtual objects the trainee interacts with. However, information gathered through cutaneous (tactile feedback) and muscle mechanoreceptors (kinesthetic feedback) regarding, e.g., object shape, is crucial to successfully interact with those objects. To provide this essential information, previous haptic interfaces have targeted to render either tactile or kinesthetic feedback while the effectiveness of multimodal tactile and kinesthetic feedback on the perception of the characteristics of virtual objects still remains largely unexplored. Here, we present the results from an experiment we conducted with sixteen participants to evaluate the effectiveness of multimodal tactile and kinesthetic feedback on shape perception. Using a within-subject design, participants were asked to reproduce virtual shapes after exploring them without visual feedback and with either congruent tactile and kinesthetic feedback or with only kinesthetic feedback. Tactile feedback was provided with a cable-driven platform mounted on the fingertip, while kinesthetic feedback was provided using a haptic glove. To measure the participants' ability to perceive and reproduce the rendered shapes, we measured the time participants spent exploring and reproducing the shapes and the error between the rendered and reproduced shapes after exploration. Furthermore, we assessed the participants' workload and motivation using well-established questionnaires. We found that concurrent tactile and kinesthetic feedback during shape exploration resulted in lower reproduction errors and longer reproduction times. The longer reproduction times for the combined condition may indicate that participants could learn the shapes better and, thus, were more careful when reproducing them. We did not find differences between conditions in the time spent exploring the shapes or the participants' workload and motivation. The lack of differences in workload between conditions could be attributed to the reported minimal-to-intermediate workload levels, suggesting that there was little room to further reduce the workload. Our work highlights the potential advantages of multimodal congruent tactile and kinesthetic feedback when interacting with tangible virtual objects with applications in virtual simulators for hands-on training applications.

Haptic Information Feedback Given to Handles in Guide Dog Training

Tactile Apparent Movement As A Modality For Lower Limb Haptic Feedback

Training Induced Improvement on Human Perception of the Force Feedback Provided by A Soft Robotic Glove

A Hand-Held Device Presenting Haptic Directional Cues for the Visually Impaired

User Testing on Conveying Haptic Directional Information

Haptic Stiffness Perception Using Hand Exoskeletons in Tactile Robotic Telemanipulation

Wrapping Haptic Displays Around Robot Arms to Communicate Learning

Holdable Haptic Device for 4-DOF Motion Guidance

Virtual Hand Deformation-Based Pseudo-Haptic Feedback for Enhanced Force Perception and Task Performance in Physically Constrained Teleoperation

Guidance of the Center of Pressure Using Haptic Presentation

Telepresence augmentation for visual and haptic guided immersive teleoperation of industrial manipulator

Wrapped Haptic Display for Communicating Physical Robot Learning

Haptics in Teleoperated Medical Interventions: Force Measurement, Haptic Interfaces and Their Influence on User's Performance

A Lightweight Haptic Interface for Hand-to-Object Tasks with Spatiotemporal Displays

Bilaterally Shared Haptic Perception for Human-Robot Collaboration in Grasping Operation

Haptic guidance improves the visuo-manual tracking of trajectories

Experimental Evaluation of a Hybrid Sensory Feedback System for Haptic and Kinaesthetic Perception in Hand Prostheses

Proposal and Evaluation of Visual Haptics for Manipulation of Remote Machine System

Evaluating tactile feedback in addition to kinesthetic feedback for haptic shape rendering: a pilot study

Move or Push? Studying Pseudo-Haptic Perceptions Obtained with Motion or Force Input

Haptic Feedback of Tool Vibrations Facilitates Telerobotic Construction