Interactive medical image segmentation via a point-based interaction
Jian Zhang,Yinghuan Shi,Jinquan Sun,Lei Wang,Luping Zhou,Yang Gao,Dinggang Shen
DOI: https://doi.org/10.1016/j.artmed.2020.101998
IF: 7.011
2021-01-01
Artificial Intelligence in Medicine
Abstract:<p>Due to low tissue contrast, irregular shape, and large location variance, segmenting the objects from different medical imaging modalities (<em>e.g.</em>, CT, MR) is considered as an important yet challenging task. In this paper, we present a novel method for interactive medical image segmentation with the following merits. (1) Our design is fundamentally different from previous pure patch-based and image-based segmentation methods. We observe that during delineation, the physician repeatedly check the intensity from area inside-object to outside-object to determine the boundary, which indicates that <em>comparison in an inside-out manner is extremely important</em>. Thus, we innovatively model our segmentation task as learning the representation of the bi-directional sequential patches, starting from (or ending in) the given central point of the object. This can be realized by our proposed ConvRNN network embedded with a gated memory propagation unit. (2) Unlike previous interactive methods (requiring bounding box or seed points), we only ask the physician to merely click on the rough central point of the object before segmentation, which could simultaneously enhance the performance and reduce the segmentation time. (3) We utilize our method in a multi-level framework for better performance. We systematically evaluate our method in three different segmentation tasks, including CT kidney tumor, MR prostate, and PROMISE12 challenge, showing promising results compared with state-of-the-art methods.</p>
engineering, biomedical,computer science, artificial intelligence,medical informatics