Abstract:Recent advancements in virtual reality (VR) technology facilitate tracking real-world objects and users' movements in the virtual environment (VE) and inspire researchers to develop a physics-based haptic system (i.e., real object haptics) instead of computer-generated haptic feedback. However, there is limited research on the efficacy of such VR systems in enhancing operators' sensorimotor learning for tasks that require high motor and physical demands. Therefore, this study aimed to design and evaluate the efficacy of a physics-based VR system that provides users with realistic cutaneous and kinesthetic haptic feedback. We designed a physics-based VR system, named PhyVirtual, and simulated human–robot collaborative (HRC) sequential pick-and-place lifting tasks in the VE. Participants performed the same tasks in the real environment (RE) with human–human collaboration instead of human–robot collaboration. We used a custom-designed questionnaire, the NASA-TLX, and electromyography activities from biceps, middle, and anterior deltoid muscles to determine user experience, workload, and neuromuscular dynamics, respectively. Overall, the majority of responses (>65%) demonstrated that the system is easy-to-use, easy-to-learn, and effective in improving motor skill performance. While compared to tasks performed in the RE, no significant difference was observed in the overall workload for the PhyVirtual system. The electromyography data exhibited similar trends (p > 0.05; r > 0.89) for both environments. These results show that the PhyVirtual system is an effective tool to simulate safe human–robot collaboration commonly seen in many modern warehousing settings. Moreover, it can be used as a viable replacement for live sensorimotor training in a wide range of fields.

HapticProxy: Providing Positional Vibrotactile Feedback on a Physical Proxy for Virtual-Real Interaction in Augmented Reality

Robotic Haptic Proxies for Collaborative Virtual Reality

Virtual-Physical Interaction System

Towards Robotic Haptic Proxies in Virtual Reality

Proxy Importance Based Haptic Retargeting With Multiple Props in VR

Prop-oriented world rotation: enabling passive haptic feedback by aligning real and virtual objects in virtual reality

A Proof of Concept Integrated Multi-systems Approach for Large Scale Tactile Feedback in VR

MoveVR: Enabling Multiform Force Feedback in Virtual Reality Using Household Cleaning Robot.

Telepresence augmentation for visual and haptic guided immersive teleoperation of industrial manipulator

A touchable virtual screen interaction system with handheld Kinect camera

Evaluating Visual-Spatiotemporal Co-Registration of a Physics-Based Virtual Reality Haptic Interface

Wearable teleoperation controller with 2-DoF robotic arm and haptic feedback for enhanced interaction in virtual reality

Haptic Feedback Relocation from the Fingertips to the Wrist for Two-Finger Manipulation in Virtual Reality

A Physics-Based Virtual Reality Haptic System Design and Evaluation by Simulating Human-Robot Collaboration

Enhanced Wearable Force-Feedback Mechanism for Free-Range Haptic Experience Extended by Pass-Through Mixed Reality

Grasp Identification and Multi-Finger Haptic Feedback for Virtual Assembly

The user experience of distal arm-level vibrotactile feedback for interactions with virtual versus physical displays

Usability of Pseudo-Haptic Feedback for Manual Precise Manipulation of Objects in Augmented Reality

ViboPneumo: A Vibratory-Pneumatic Finger-Worn Haptic Device for Altering Perceived Texture Roughness in Mixed Reality

Peripersonal Space Tele-Operation in Virtual Reality: The Role of Tactile - Force Feedback

Haptic Repurposing with GenAI