Abstract:The use of Virtual Reality (VR) technology, especially in medical rehabilitation, has expanded to include tactile cues along with visual stimuli. For patients with upper limb hemiplegia, tangible handles with haptic stimuli could improve their ability to perform daily activities. Traditional VR controllers are unsuitable for patient rehabilitation in VR, necessitating the design of specialized tangible handles with integrated tracking devices. Besides, matching tactile stimulation with corresponding virtual visuals could strengthen users' embodiment (i.e., owning and controlling virtual bodies) in VR, which is crucial for patients' training with virtual hands. Haptic stimuli have been shown to amplify the embodiment in VR, whereas the effect of partial tactile stimulation from tangible handles on embodiment remains to be clarified. This research, including three experiments, aims to investigate how partial tactile feedback of tangible handles impacts users' embodiment, and we proposed a design concept called TouchMark for partial tactile stimuli that could help users quickly connect the physical and virtual worlds. To evaluate users' tactile and comfort perceptions when grasping tangible handles in a non-VR setting, various handles with three partial tactile factors were manipulated in Study 1. In Study 2, we explored the effects of partial feedback using three forms of TouchMark on the embodiment of healthy users in VR, with various tangible handles, while Study 3 focused on similar investigations with patients. These handles were utilized to complete virtual food preparation tasks. The tactile and comfort perceptions of tangible handles and users' embodiment were evaluated in this research using questionnaires and interviews. The results indicate that TouchMark with haptic line and ring forms over no stimulation would significantly enhance users' embodiment, especially for patients. The low-cost and innovative TouchMark approach may assist users, particularly those with limited VR experience, in achieving the embodiment and enhancing their virtual interactive experience.

Tangiball: Foot-Enabled Embodied Tangible Interaction with a Ball in Virtual Reality

Evaluating Object Manipulation Interaction Techniques in Mixed Reality: Tangible User Interfaces and Gesture

TouchMark: Partial Tactile Feedback Design for Upper Limb Rehabilitation in Virtual Reality

Touching the future of training: investigating tangible interaction in virtual reality

Tangible and Mid-Air Interactions in Hand-Held Augmented Reality for Upper Limb Rehabilitation: An Evaluation of User Experience and Motor Performance

Building Virtual Entertainment Environment with Tiled Display Wall and Motion Tracking.

Tangible Web: An Interactive Immersion Virtual RealityCreativity System that Travels Across Reality

The user experience of distal arm-level vibrotactile feedback for interactions with virtual versus physical displays

Unity game engine: interactive software design using digital glove for virtual reality baseball pitch training

MobiTangibles: Enabling Physical Manipulation Experiences of Virtual Precision Hand-Held Tools' Miniature Control in VR

How Foot Tracking Matters: The Impact of an Animated Self-Avatar on Interaction, Embodiment and Presence in Shared Virtual Environments

Interpretation of Tactile Sensation using an Anthropomorphic Finger Motion Interface to Operate a Virtual Avatar

VR-Stepper: A Do-It-Yourself Game Interface For Locomotion In Virtual Environments

Leaning-Based Interfaces Improve Simultaneous Locomotion and Object Interaction in VR Compared to the Handheld Controller

Enhancing User Experience in Virtual Museums: Impact of Finger Vibrotactile Feedback

"If you've gone straight, now, you must turn left" - Exploring the use of a tangible interface in a collaborative treasure hunt for people with visual impairments

Perspectives from Naive Participants and Experienced Social Science Researchers on Addressing Embodiment in a Virtual Cyberball Task

Exploring Bi-Manual Teleportation in Virtual Reality

FingerMapper: Mapping Finger Motions onto Virtual Arms to Enable Safe Virtual Reality Interaction in Confined Spaces

Peripersonal Space Tele-Operation in Virtual Reality: The Role of Tactile - Force Feedback

A Lightweight and Efficient System for Tracking Handheld Objects in Virtual Reality