Development of novel Mixed Reality-Based Simulator for Endoscopic Transnasal Surgery with HoloLens and multiple AR tracker

Yoshihide Katayama,Naokado Ikeda,Shinji Kawabata,Motomasa Furuse,Naosuke Nonoguchi,Ryokichi Yagi,Ryo Hiramatsu,Takahiro Fujishiro,Yoji Tamura,Toshihiko Kuroiwa,Tomoki Itamiya,Masahiko Wanibuchi
DOI: https://doi.org/10.21203/rs.3.rs-984404/v1
2021-10-18
Abstract:Abstract Background Virtual reality (VR) and mixed reality (MR) are now widely applied for preoperative simulation and intraoperative navigation. Methods We developed an MR-based simulator for endoscopic transnasal surgery (ETNS) with a head-mounted display HoloLens and evaluated its usefulness. This simulator consisted of MR images of patients and an MR endoscope. HoloLens was used for projection of MR images and recognition of markers. The MR images were reconstructed from the preoperative images of patients and superimposed onto the endoscopic training model of the head. The MR endoscope was superimposed onto a three-dimensional (3D) printed replica of an endoscope. The MR endoscopic images from the replica of the endoscope were projected in the operator’s visual field. The MR images followed the manipulation of the replica of the endoscope through a nasal cavity on the training model. To evaluate the developed simulator, the MR endoscopic images were compared with video-recorded actual operative endoscopic views. And face validity and content validity of the simulator were evaluated by senior residents, using a 5-point Likert scale. Result The 3D MR images through HoloLens correlated well with the actual intraoperative views. Although there was an innate learning curve with the simulator, the face validity and the content validity demonstrated effective simulation of an operative field of view with real-time characteristics of the surgical procedure. Conclusions Our developed simulator for ETNS will contribute to learning the unique and the limited surgical fields through the narrow surgical corridor with endoscope, particularly for novice surgeons.
What problem does this paper attempt to address?