Abstract:The use of Virtual Reality (VR) technology, especially in medical rehabilitation, has expanded to include tactile cues along with visual stimuli. For patients with upper limb hemiplegia, tangible handles with haptic stimuli could improve their ability to perform daily activities. Traditional VR controllers are unsuitable for patient rehabilitation in VR, necessitating the design of specialized tangible handles with integrated tracking devices. Besides, matching tactile stimulation with corresponding virtual visuals could strengthen users' embodiment (i.e., owning and controlling virtual bodies) in VR, which is crucial for patients' training with virtual hands. Haptic stimuli have been shown to amplify the embodiment in VR, whereas the effect of partial tactile stimulation from tangible handles on embodiment remains to be clarified. This research, including three experiments, aims to investigate how partial tactile feedback of tangible handles impacts users' embodiment, and we proposed a design concept called TouchMark for partial tactile stimuli that could help users quickly connect the physical and virtual worlds. To evaluate users' tactile and comfort perceptions when grasping tangible handles in a non-VR setting, various handles with three partial tactile factors were manipulated in Study 1. In Study 2, we explored the effects of partial feedback using three forms of TouchMark on the embodiment of healthy users in VR, with various tangible handles, while Study 3 focused on similar investigations with patients. These handles were utilized to complete virtual food preparation tasks. The tactile and comfort perceptions of tangible handles and users' embodiment were evaluated in this research using questionnaires and interviews. The results indicate that TouchMark with haptic line and ring forms over no stimulation would significantly enhance users' embodiment, especially for patients. The low-cost and innovative TouchMark approach may assist users, particularly those with limited VR experience, in achieving the embodiment and enhancing their virtual interactive experience.

A Proof of Concept Integrated Multi-systems Approach for Large Scale Tactile Feedback in VR

TouchVR: a Wearable Haptic Interface for VR Aimed at Delivering Multi-modal Stimuli at the User's Palm

UltraBots: Large-Area Mid-Air Haptics for VR with Robotically Actuated Ultrasound Transducers

A Physics-Based Virtual Reality Haptic System Design and Evaluation by Simulating Human-Robot Collaboration

A Study on Immersion and Presence of a Portable Hand Haptic System for Immersive Virtual Reality

Integrating haptic-tactile feedback into a video-capture-based virtual environment for rehabilitation

Bimanual Ultrasound Mid-Air Haptics for Virtual Reality Manipulation

Virtual-Physical Interaction System

Multi-modal Sensing-Based Interactive Glove System for Teleoperation and VR/AR

Proposal and Evaluation of Visual Haptics for Manipulation of Remote Machine System

Can Stiffness Sensations Be Rendered in Virtual Reality Using Mid-air Ultrasound Haptic Technologies?

A Robotic Haptic Feedback Device for Immersive Virtual Reality Applications

"Can I Touch This?": Survey of Virtual Reality Interactions via Haptic Solutions

Haptic Sensing and Feedback Techniques toward Virtual Reality

Proof of Concept for the Use of Immersive Virtual Reality in Upper Limb Rehabilitation of Multiple Sclerosis Patients

The user experience of distal arm-level vibrotactile feedback for interactions with virtual versus physical displays

HapticProxy: Providing Positional Vibrotactile Feedback on a Physical Proxy for Virtual-Real Interaction in Augmented Reality

HapticBots: Distributed Encountered-type Haptics for VR with Multiple Shape-changing Mobile Robots

Evaluating Visual-Spatiotemporal Co-Registration of a Physics-Based Virtual Reality Haptic Interface

Encountered-Type Haptic Display via Tracking Calibrated Robot

TouchMark: Partial Tactile Feedback Design for Upper Limb Rehabilitation in Virtual Reality