CATARACTS: Challenge on automatic tool annotation for cataRACT surgery
Hassan Al Hajj,Mathieu Lamard,Pierre-Henri Conze,Soumali Roychowdhury,Xiaowei Hu,Gabija Maršalkaitė,Odysseas Zisimopoulos,Muneer Ahmad Dedmari,Fenqiang Zhao,Jonas Prellberg,Manish Sahu,Adrian Galdran,Teresa Araújo,Duc My Vo,Chandan Panda,Navdeep Dahiya,Satoshi Kondo,Zhengbing Bian,Arash Vahdat,Jonas Bialopetravičius,Evangello Flouty,Chenhui Qiu,Sabrina Dill,Anirban Mukhopadhyay,Pedro Costa,Guilherme Aresta,Senthil Ramamurthy,Sang-Woong Lee,Aurélio Campilho,Stefan Zachow,Shunren Xia,Sailesh Conjeti,Danail Stoyanov,Jogundas Armaitis,Pheng-Ann Heng,William G Macready,Béatrice Cochener,Gwenolé Quellec,William G. Macready
DOI: https://doi.org/10.1016/j.media.2018.11.008
IF: 10.9
2019-02-01
Medical Image Analysis
Abstract:Surgical tool detection is attracting increasing attention from the medical image analysis community. The goal generally is not to precisely locate tools in images, but rather to indicate which tools are being used by the surgeon at each instant. The main motivation for annotating tool usage is to design efficient solutions for surgical workflow analysis, with potential applications in report generation, surgical training and even real-time decision support. Most existing tool annotation algorithms focus on laparoscopic surgeries. However, with 19 million interventions per year, the most common surgical procedure in the world is cataract surgery. The CATARACTS challenge was organized in 2017 to evaluate tool annotation algorithms in the specific context of cataract surgery. It relies on more than nine hours of videos, from 50 cataract surgeries, in which the presence of 21 surgical tools was manually annotated by two experts. With 14 participating teams, this challenge can be considered a success. As might be expected, the submitted solutions are based on deep learning. This paper thoroughly evaluates these solutions: in particular, the quality of their annotations are compared to that of human interpretations. Next, lessons learnt from the differential analysis of these solutions are discussed. We expect that they will guide the design of efficient surgery monitoring tools in the near future.
engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging