How to exploit Augmented Reality (AR) technology in patient customized surgical tools: a focus on osteotomies

Luca Ulrich,Federico Salerno,Sandro Moos,Enrico Vezzetti

DOI: https://doi.org/10.1007/s11042-023-18058-y

IF: 2.577

2024-01-31

Multimedia Tools and Applications

Abstract:Abstract In orthopedic surgery and maxillofacial there is a growing use of augmented reality (AR) as a technology to increase the visual perception of the surgeon in the operating room. The objective of this review is to analyze the state of the art in the use of AR for osteotomies, highlighting the advantages and the most-known open issues to be addressed in the future research. Scopus, Web of Science, Pubmed and IEEE Xplore databases have been explored with a keyword search, setting the time limits from January 2017 to January 2023, inclusive. Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines has been used in this review, focusing on anatomical districts, real-virtual environment interaction, advantaged and limitations of existing AR-based applications. 49 articles met the inclusion criteria and have been selected in the final analysis. For the sake of clarity, works have been grouped according to the anatomical district, but also the real-virtual environment interaction methodology was reported, as well as information regarding accuracy assessment. A Quality Function Deployment (QFD) has been used to assess the AR-based solutions with regards to the more traditional freehand (FH) and Patient Specific Template (PST) approaches. Finally, some suggestions to foster the AR-based solution adoption in osteotomies treatment have been drawn, considering the highlighted advantages and limitations of this technology. The AR resulted to meet the surgeons’ needs more than other traditional approaches. Among the emerged advantages, AR can lead to a better surgical field accessibility, more flexible solutions and lower the management effort. Nonetheless, future research should address some well-known issues, among which the calibration time, the robustness of the tracking, and the HMDs discomfort.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering

What problem does this paper attempt to address?

The paper primarily explores how augmented reality (AR) technology can be utilized to improve the accuracy and efficiency of bone cutting surgeries, particularly osteotomies in orthognathic surgery. Specifically, the paper focuses on the following aspects:

1. **Research Background**: With the development of augmented reality technology, it is increasingly being applied in orthognathic and maxillofacial surgeries to enhance surgeons' visual perception in the operating room.

2. **Research Objective**: This paper aims to review the latest advancements in using AR technology for osteotomies, highlighting its advantages and identifying key issues that still need to be addressed.

3. **Literature Review Method**: The authors screened relevant literature by keyword search from the Scopus, Web of Science, PubMed, and IEEE Xplore databases, with a time range limited from January 2017 to January 2023, following the PRISMA guidelines for systematic reviews and meta-analyses.

4. **Research Findings**:
- Among the 49 articles included in the final analysis, the researchers categorized the literature by anatomical region and reported methods of interaction between real and virtual environments, as well as information on accuracy assessments.
- Using Quality Function Deployment (QFD), AR-based solutions were compared with traditional freehand (FH) and patient-specific template (PST) methods.
- AR technology was found to better meet the needs of surgeons compared to other traditional methods. The advantages of AR include improved accessibility to the surgical field, providing more flexible solutions, and reducing management difficulty.
- However, future research needs to address some known issues, such as calibration time, tracking robustness, and discomfort with head-mounted displays (HMDs).

5. **Application Examples**: The paper lists several cases demonstrating the application of AR in different anatomical regions, such as the orthognathic area, pelvic area, and lower limbs. It also discusses various types of physical markers and their roles in the registration process, as well as different accuracy assessment methods.

6. **Conclusion**: The application of AR technology in osteotomies shows significant advantages but still faces some challenges. To promote further adoption of AR technology in bone cutting treatments, future research should focus on improving these limitations.

In summary, this paper emphasizes the potential value of AR technology in orthognathic surgeries through a systematic review of existing literature and points out the future research directions in this field.