A Distributed Augmented Reality System for Medical Training and Simulation

Felix G. Hamza-Lup,Jannick P. Rolland,Charles Hughes

DOI: https://doi.org/10.48550/arXiv.1811.12815

2018-11-29

Abstract:Augmented Reality (AR) systems describe the class of systems that use computers to overlay virtual information on the real world. AR environments allow the development of promising tools in several application domains. In medical training and simulation the learning potential of AR is significantly amplified by the capability of the system to present 3D medical models in real-time at remote locations. Furthermore the simulation applicability is broadened by the use of real-time deformable medical models. This work presents a distributed medical training prototype designed to train medical practitioners' hand-eye coordination when performing endotracheal intubations. The system we present accomplishes this task with the help of AR paradigms. An extension of this prototype to medical simulations by employing deformable medical models is possible. The shared state maintenance of the collaborative AR environment is assured through a novel adaptive synchronization algorithm (ASA) that increases the sense of presence among participants and facilitates their interactivity in spite of infrastructure delays. The system will allow paramedics, pre-hospital personnel, and students to practice their skills without touching a real patient and will provide them with the visual feedback they could not otherwise obtain. Such a distributed AR training tool has the potential to: allow an instructor to simultaneously train local and remotely located students and, allow students to actually "see" the internal anatomy and therefore better understand their actions on a human patient simulator (HPS).

Distributed, Parallel, and Cluster Computing,Human-Computer Interaction

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is to improve the training effect and safety of the Endotracheal Intubation (ETI) procedure in medical training. Specifically, the paper proposes a prototype system of distributed medical training based on Augmented Reality (AR), aiming to improve the training of medical personnel in the following ways:

1. **Improve hand - eye coordination**: The system utilizes AR technology to help medical personnel improve their hand - eye coordination when performing endotracheal intubation, especially during real - time training at remote locations.

2. **Use deformable medical models**: By introducing deformable 3D medical models to simulate real - medical scenarios, making the training more realistic and effective.

3. **Shared - state maintenance**: A new Adaptive Synchronization Algorithm (ASA) is proposed to ensure that all participants in a distributed collaborative AR environment can maintain a consistent view and achieve a good interactive experience even in the presence of network latency.

4. **Remote training**: Allows instructors to train both local and remote students simultaneously, improving the flexibility and efficiency of training.

5. **Visualize internal anatomical structures**: Students can "see" the internal anatomical structures of the human body through AR technology, so as to better understand their operations on simulated patients.

Through these methods, the paper aims to provide an efficient, safe, and highly interactive medical training tool, especially in emergency medical situations, which can significantly improve the skills and response capabilities of medical personnel.