A Review on Organ Deformation Modeling Approaches for Reliable Surgical Navigation using Augmented Reality

Zheng Han,Qi Dou

DOI: https://doi.org/10.1080/24699322.2024.2357164

2024-08-05

Abstract:Augmented Reality (AR) holds the potential to revolutionize surgical procedures by allowing surgeons to visualize critical structures within the patient's body. This is achieved through superimposing preoperative organ models onto the actual anatomy. Challenges arise from dynamic deformations of organs during surgery, making preoperative models inadequate for faithfully representing intraoperative anatomy. To enable reliable navigation in augmented surgery, modeling of intraoperative deformation to obtain an accurate alignment of the preoperative organ model with the intraoperative anatomy is indispensable. Despite the existence of various methods proposed to model intraoperative organ deformation, there are still few literature reviews that systematically categorize and summarize these approaches. This review aims to fill this gap by providing a comprehensive and technical-oriented overview of modeling methods for intraoperative organ deformation in augmented reality in surgery. Through a systematic search and screening process, 112 closely relevant papers were included in this review. By presenting the current status of organ deformation modeling methods and their clinical applications, this review seeks to enhance the understanding of organ deformation modeling in AR-guided surgery, and discuss the potential topics for future advancements.

Medical Physics,Artificial Intelligence,Human-Computer Interaction,Image and Video Processing

What problem does this paper attempt to address?

The main aim of this paper is to address the issue of accurately modeling intraoperative organ deformation in augmented reality (AR)-guided surgery. AR technology can help surgeons better visualize key structures within a patient's body by overlaying preoperatively acquired 3D models of organs onto the actual anatomical structures. However, during surgery, organs undergo dynamic deformation, causing the preoperatively constructed models to mismatch with the intraoperative real anatomical structures, thereby affecting the accuracy of surgical navigation.

To solve the aforementioned problem, the paper provides a comprehensive technical review, covering various existing methods for intraoperative organ deformation modeling and systematically classifying and summarizing them. Through a systematic search and screening of relevant literature, a total of 112 closely related research papers were included in the review.

The paper categorizes existing organ deformation modeling methods into three types: model-based methods, data-driven methods, and hybrid methods. Model-based methods include biomechanical models, physics-based modeling methods, geometric alignment methods, and statistical models; data-driven methods include atlas-based methods and machine learning methods; while hybrid methods combine the advantages of the aforementioned two types of methods.

Additionally, the paper discusses the unique challenges faced by different surgical specialties and presents existing solutions to these challenges, concluding with an outlook on future research directions.

In summary, the goal of this review is to enhance the understanding of organ deformation modeling in surgical procedures by synthesizing existing research findings and to promote further development in this field.