Abstract:Purpose: Training deep neural networks usually require a large number of human-annotated data. For organ segmentation from volumetric medical images, human annotation is tedious and inefficient. To save human labour and to accelerate the training process, the strategy of annotation by iterative deep learning recently becomes popular in the research community. However, due to the lack of domain knowledge or efficient human-interaction tools, the current AID methods still suffer from long training time and high annotation burden. Methods: We develop a contour-based annotation by iterative deep learning (AID) algorithm which uses boundary representation instead of voxel labels to incorporate high-level organ shape knowledge. We propose a contour segmentation network with a multi-scale feature extraction backbone to improve the boundary detection accuracy. We also developed a contour-based human-intervention method to facilitate easy adjustments of organ boundaries. By combining the contour-based segmentation network and the contour-adjustment intervention method, our algorithm achieves fast few-shot learning and efficient human proofreading. Results: For validation, two human operators independently annotated four abdominal organs in computed tomography (CT) images using our method and two compared methods, i.e. a traditional contour-interpolation method and a state-of-the-art (SOTA) convolutional network (CNN) method based on voxel label representation. Compared to these methods, our approach considerably saved annotation time and reduced inter-rater variabilities. Our contour detection network also outperforms the SOTA nnU-Net in producing anatomically plausible organ shape with only a small training set. Conclusion: Taking advantage of the boundary shape prior and the contour representation, our method is more efficient, more accurate and less prone to inter-operator variability than the SOTA AID methods for organ segmentation from volumetric medical images. The good shape learning ability and flexible boundary adjustment function make it suitable for fast annotation of organ structures with regular shape.

End-to-End Adversarial Shape Learning for Abdomen Organ Deep Segmentation

Abdominal multi-organ segmentation with cascaded convolutional and adversarial deep networks

Adversarial deep learning for improved abdominal organ segmentation in CT scans

Deep Multi-Task and Task-Specific Feature Learning Network for Robust Shape Preserved Organ Segmentation.

Shape-Aware Organ Segmentation by Predicting Signed Distance Maps

Learning to In-paint: Domain Adaptive Shape Completion for 3D Organ Segmentation

Boundary-Aware Network for Abdominal Multi-Organ Segmentation

Improved Abdominal Multi-Organ Segmentation via 3D Boundary-Constrained Deep Neural Networks

AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem

Unsupervised Domain Adaptation through Shape Modeling for Medical Image Segmentation

Recurrent Feature Propagation and Edge Skip-Connections for Automatic Abdominal Organ Segmentation

Abdominal organ segmentation via deep diffeomorphic mesh deformations

Deep Shape Analysis on Abdominal Organs for Diabetes Prediction

Semi-Supervised 3D Abdominal Multi-Organ Segmentation Via Deep Multi-Planar Co-Training

Dual Knowledge‐guided Two‐stage Model for Precise Small Organ Segmentation in Abdominal CT Images

Abdominal multi-organ segmentation in Multi-sequence MRIs based on visual attention guided network and knowledge distillation

Efficient contour-based annotation by iterative deep learning for organ segmentation from volumetric medical images

Liver segmentation using 3D CNNs with high level shape constraints

Teaching AI the Anatomy Behind the Scan: Addressing Anatomical Flaws in Medical Image Segmentation with Learnable Prior

A multi-scale pyramid of 3D fully convolutional networks for abdominal multi-organ segmentation

Semi-supervised Abdominal Multi-organ Segmentation Via Contour Aware Dual-Task Consistency