VR Isle Academy: A VR Digital Twin Approach for Robotic Surgical Skill Development

Achilleas Filippidis,Nikolaos Marmaras,Michael Maravgakis,Alexandra Plexousaki,Manos Kamarianakis,George Papagiannakis

2024-07-01

Abstract:Contemporary progress in the field of robotics, marked by improved efficiency and stability, has paved the way for the global adoption of surgical robotic systems (SRS). While these systems enhance surgeons' skills by offering a more accurate and less invasive approach to operations, they come at a considerable cost. Moreover, SRS components often involve heavy machinery, making the training process challenging due to limited access to such equipment. In this paper we introduce a cost-effective way to facilitate training for a simulator of a SRS via a portable, device-agnostic, ultra realistic simulation with hand tracking and feet tracking support. Error assessment is accessible in both real-time and offline, which enables the monitoring and tracking of users' performance. The VR application has been objectively evaluated by several untrained testers showcasing significant reduction in error metrics as the number of training sessions increases. This indicates that the proposed VR application denoted as VR Isle Academy operates efficiently, improving the robot - controlling skills of the testers in an intuitive and immersive way towards reducing the learning curve at minimal cost.

Robotics,Graphics

What problem does this paper attempt to address?

The problem this paper attempts to address is:

In the training of Surgical Robotic Systems (SRS), existing training methods are costly, cumbersome, and difficult to access. These issues lead to inconvenience and inefficiency in the training process. To overcome these challenges, the paper proposes a portable, low-cost, and highly realistic surgical robotic system training simulator based on Virtual Reality (VR) — VR Isle Academy.

Specifically, the main contributions of the paper include:
1. **Cost-effectiveness**: By using portable VR equipment, it reduces the reliance on expensive physical SRS training equipment, thereby lowering training costs.
2. **Portability and flexibility**: Users can train at any location and time, without being restricted by geographical location and time.
3. **Immersive experience**: Through hand and foot tracking technology, it provides a more realistic and immersive training experience, enhancing users' operational skills.
4. **Real-time and offline assessment**: It offers real-time and offline error assessment and performance monitoring, helping users track and improve their performance.

The paper achieves the above goals by developing a complete digital twin of the SRS, making the training of surgical robotic systems more convenient, efficient, and economical.