Abstract:Recent advancements in virtual reality (VR) technology facilitate tracking real-world objects and users' movements in the virtual environment (VE) and inspire researchers to develop a physics-based haptic system (i.e., real object haptics) instead of computer-generated haptic feedback. However, there is limited research on the efficacy of such VR systems in enhancing operators' sensorimotor learning for tasks that require high motor and physical demands. Therefore, this study aimed to design and evaluate the efficacy of a physics-based VR system that provides users with realistic cutaneous and kinesthetic haptic feedback. We designed a physics-based VR system, named PhyVirtual, and simulated human–robot collaborative (HRC) sequential pick-and-place lifting tasks in the VE. Participants performed the same tasks in the real environment (RE) with human–human collaboration instead of human–robot collaboration. We used a custom-designed questionnaire, the NASA-TLX, and electromyography activities from biceps, middle, and anterior deltoid muscles to determine user experience, workload, and neuromuscular dynamics, respectively. Overall, the majority of responses (>65%) demonstrated that the system is easy-to-use, easy-to-learn, and effective in improving motor skill performance. While compared to tasks performed in the RE, no significant difference was observed in the overall workload for the PhyVirtual system. The electromyography data exhibited similar trends (p > 0.05; r > 0.89) for both environments. These results show that the PhyVirtual system is an effective tool to simulate safe human–robot collaboration commonly seen in many modern warehousing settings. Moreover, it can be used as a viable replacement for live sensorimotor training in a wide range of fields.

Enhance Kinesthetic Experience in Perceptual Learning for Welding Motor Skill Acquisition with Virtual Reality and Robot-based Haptic Guidance

A Multi-Sensor Interface to Improve the Learning Experience in Arc Welding Training Tasks

Mixed Reality-Enhanced Intuitive Teleoperation with Hybrid Virtual Fixtures for Intelligent Robotic Welding

Haptic-Based Training for Tank Gunnery Using Decoupled Motion Control

Development of an Intuitive Interface with Haptic Enhancement for Robot-Assisted Endovascular Intervention.

Adaptive Virtual Guides for Compliance Control Skill Teaching in Partially Known Tasks

A Novel Visual Guidance Framework for Robotic Welding Based on Binocular Cooperation

Designing a robot-assisted rehabilitation system for hand function recovery using virtual reality and haptic robot

Research on Teaching a Welding Implementation Course Assisted by Sustainable Virtual Reality Technology

Latency Mitigation Using Applied HMMs for Mixed Reality-Enhanced Intuitive Teleoperation in Intelligent Robotic Welding

Application of Computer Virtual Reality Technology in Welding Simulation Training of Complex Structures Based on Unity3D

Design and implementation of a dexterous human-robot interaction system based on haptic shared control

Training Induced Improvement on Human Perception of the Force Feedback Provided by A Soft Robotic Glove

Research on Virtual Reality Monitoring Technology of Tele-operation Welding Robot

A Teaching-Free Welding Method Based on Laser Visual Sensing System in Robotic GMAW

Telepresence augmentation for visual and haptic guided immersive teleoperation of industrial manipulator

A Physics-Based Virtual Reality Haptic System Design and Evaluation by Simulating Human-Robot Collaboration

Robotics via Experiential Active Learning With Immersive Technology: A Pedagogical Framework Designed for Engineering Curricula

Virtual Reality Based Tactile Sensing Enhancements for Bilateral Teleoperation System with In-Hand Manipulation

Virtual Environments for Hand Rehabilitation with Force Feedback.

Control of human welder's arm movement in manual gas tungsten arc welding (GTAW) process