Surgical navigation systems based on augmented reality technologies

Vladimir Ivanov,Anton Krivtsov,Sergey Strelkov,Dmitry Gulyaev,Denis Godanyuk,Nikolay Kalakutsky,Artyom Pavlov,Marina Petropavloskaya,Alexander Smirnov,Andrew Yaremenko
DOI: https://doi.org/10.48550/arXiv.2106.00727
2021-05-13
Abstract:This study considers modern surgical navigation systems based on augmented reality technologies. Augmented reality glasses are used to construct holograms of the patient's organs from MRI and CT data, subsequently transmitted to the glasses. This, in addition to seeing the actual patient, the surgeon gains visualization inside the patient's body (bones, soft tissues, blood vessels, etc.). The solutions developed at Peter the Great St. Petersburg Polytechnic University allow reducing the invasiveness of the procedure and preserving healthy tissues. This also improves the navigation process, making it easier to estimate the location and size of the tumor to be removed. We describe the application of developed systems to different types of surgical operations (removal of a malignant brain tumor, removal of a cyst of the cervical spine). We consider the specifics of novel navigation systems designed for anesthesia, for endoscopic operations. Furthermore, we discuss the construction of novel visualization systems for ultrasound machines. Our findings indicate that the technologies proposed show potential for telemedicine.
Human-Computer Interaction
What problem does this paper attempt to address?
This paper aims to explore modern surgical navigation systems based on augmented reality technology. Specifically, the researchers have developed a technology for constructing holograms of patient organs (such as bones, soft tissues, blood vessels, etc.) using augmented reality glasses. These holograms are generated from MRI and CT data and transmitted to the glasses. In this way, in addition to seeing the actual patient, surgeons can also obtain visual information of the patient's internal structures. This not only reduces the invasiveness of the operation and protects healthy tissues, but also improves the navigation process, making it easier for surgeons to assess the location and size of tumors. The paper details the application of these systems in different types of surgeries, including the removal of malignant brain tumors and the removal of cervical cysts. In addition, it also discusses the special designs of these new technologies in anesthesia and endoscopic surgeries, as well as the construction of new visualization systems combined with ultrasonic devices. The research results show that these proposed technologies also show potential in telemedicine.