Augmented Reality Navigation for Liver Resection with a Stereoscopic Laparoscope.
Huoling Luo,Dalong Yin,Shugeng Zhang,Deqiang Xiao,Baochun He,Fanzheng Meng,Yanfang Zhang,Wei Cai,Shenghao He,Wenyu Zhang,Qingmao Hu,Hongrui Guo,Shuhang Liang,Shuo Zhou,Shuxun Liu,Linmao Sun,Xiao Guo,Chihua Fang,Lianxin Liu,Fucang Jia
DOI: https://doi.org/10.1016/j.cmpb.2019.105099
IF: 6.1
2020-01-01
Computer Methods and Programs in Biomedicine
Abstract:Objective: Understanding the three-dimensional (3D) spatial position and orientation of vessels and tumor(s) is vital in laparoscopic liver resection procedures. Augmented reality (AR) techniques can help surgeons see the patient's internal anatomy in conjunction with laparoscopic video images. Method: In this paper, we present an AR-assisted navigation system for liver resection based on a rigid stereoscopic laparoscope. The stereo image pairs from the laparoscope are used by an unsupervised convolutional network (CNN) framework to estimate depth and generate an intraoperative 3D liver surface. Meanwhile, 3D models of the patient's surgical field are segmented from preoperative CT images using V-Net architecture for volumetric image data in an end-to-end predictive style. A globally optimal iterative closest point (Go-ICP) algorithm is adopted to register the pre- and intraoperative models into a unified coordinate space; then, the preoperative 3D models are superimposed on the live laparoscopic images to provide the surgeon with detailed information about the subsurface of the patient's anatomy, including tumors, their resection margins and vessels. Results: The proposed navigation system is tested on four laboratory ex vivo porcine livers and five operating theatre in vivo porcine experiments to validate its accuracy. The ex vivo and in vivo reprojection errors (RPE) are 6.04 +/- 1.85 mm and 8.73 +/- 2.43 mm, respectively. Conclusion and Significance: Both the qualitative and quantitative results indicate that our AR-assisted navigation system shows promise and has the potential to be highly useful in clinical practice. (C) 2019 Elsevier B.V. All rights reserved.