Kidney edge detection in laparoscopic image data for computer-assisted surgery

Georges Hattab,Marvin Arnold,Leon Strenger,Max Allan,Darja Arsentjeva,Oliver Gold,Tobias Simpfendörfer,Lena Maier-Hein,Stefanie Speidel
DOI: https://doi.org/10.1007/s11548-019-02102-0
2019-12-11
International Journal of Computer Assisted Radiology and Surgery
Abstract:PurposeIn robotic-assisted kidney surgery, computational methods make it possible to augment the surgical scene and potentially improve patient outcome. Most often, soft-tissue registration is a prerequisite for the visualization of tumors and vascular structures hidden beneath the surface. State-of-the-art volume-to-surface registration methods, however, are computationally demanding and require a sufficiently large target surface. To overcome this limitation, the first step toward registration is the extraction of the outer edge of the kidney.MethodsTo tackle this task, we propose a deep learning-based solution. Rather than working only on the raw laparoscopic images, the network is given depth information and distance fields to predict whether a pixel of the image belongs to an edge. We evaluate our method on expert-labeled in vivo data from the EndoVis sub-challenge 2017 Kidney Boundary Detection and define the current state of the art.ResultsBy using a leave-one-out cross-validation, we report results for the most suitable network with a median precision-like, recall-like, and intersection over union (IOU) of 39.5 px, 143.3 px, and 0.3, respectively.ConclusionWe conclude that our approach succeeds in predicting the edges of the kidney, except in instances where high occlusion occurs, which explains the average decrease in the IOU score. All source code, reference data, models, and evaluation results are openly available for download: https://github.com/ghattab/kidney-edge-detection/.
engineering, biomedical,radiology, nuclear medicine & medical imaging,surgery
What problem does this paper attempt to address?