AR-Assisted Surgical Care via 5G networks for First Aid Responders

Manos Kamarianakis,Antonis Protopsaltis,George Papagiannakis

2023-03-01

Abstract:Surgeons should play a central role in disaster planning and management due to the overwhelming number of bodily injuries that are typically involved during most forms of disaster. In fact, various types of surgical procedures are performed by emergency medical teams after sudden-onset disasters, such as soft tissue wounds, orthopaedic traumas, abdominal surgeries, etc. HMD-based Augmented Reality (AR), using state-of-the-art hardware such as the Magic Leap or the Microsoft HoloLens, have long been foreseen as a key enabler for clinicians in surgical use cases, especially for procedures performed outside of the operating room. This paper describes the Use Case (UC) "AR-assisted emergency surgical care", identified in the context of the 5G-EPICENTRE EU-funded project. Specifically, the UC will experiment with holographic AR technology for emergency medical surgery teams, by overlaying deformable medical models directly on top of the patient body parts, effectively enabling surgeons to see inside (visualizing bones, blood vessels, etc.) and perform surgical actions following step-by-step instructions. The goal is to combine the computational and data-intensive nature of AR and Computer Vision algorithms with upcoming 5G network architectures deployed for edge computing so as to satisfy real-time interaction requirements and provide an efficient and powerful platform for the pervasive promotion of such applications. By developing the necessary Virtual Network Functions (VNFs) to manage data-intensive services (e.g., prerendering, caching, compression) and by exploiting available network resources and Multi-access Edge Computing (MEC) support, provided by the 5G-EPICENTRE infrastructure, this UC aims to provide powerful AR-based tools, usable on site, to first-aid responders.

Graphics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to provide efficient emergency surgical care at disaster sites. Specifically, the paper explores how to use augmented reality (AR) technology, with the support of 5G networks and edge computing, to provide first responders (such as emergency medical personnel) with a powerful tool that enables them to perform effective surgical operations at disaster sites. The paper emphasizes the important role of surgeons in disaster planning and management in disaster situations, as well as the potential contribution of using AR technology to improving surgical efficiency and quality.

The paper proposes a use case named "AR - assisted emergency surgical care" (Use Case, UC), which aims to achieve the goals in the following ways:

1. **Combining AR and 5G technology**: Use AR technology to superimpose deformable medical models onto patient body parts, allowing surgeons to "see" internal structures (such as bones, blood vessels, etc.) and perform surgical operations according to step - by - step instructions.
2. **Cloud/edge computing support**: Through 5G networks and edge computing technology, transfer computationally intensive tasks (such as rendering, image processing, etc.) to the cloud or edge nodes, reducing the computational burden on AR devices and improving the device's mobility and battery life.
3. **Remote guidance**: Allow remote experts to provide real - time guidance through AR devices, improving the operational accuracy of on - site first - aid personnel.

The paper also details the expected results, component deployment, experimental plan, and performance indicators (KPIs) of this use case, including aspects such as round - trip time (RTT), total bandwidth, and battery life improvement. Through these measures, the paper hopes to provide an efficient, portable, and powerful AR - assisted surgical care platform for first responders in public protection and disaster relief (PPDR).