Abstract:Purpose: Training deep neural networks usually require a large number of human-annotated data. For organ segmentation from volumetric medical images, human annotation is tedious and inefficient. To save human labour and to accelerate the training process, the strategy of annotation by iterative deep learning recently becomes popular in the research community. However, due to the lack of domain knowledge or efficient human-interaction tools, the current AID methods still suffer from long training time and high annotation burden. Methods: We develop a contour-based annotation by iterative deep learning (AID) algorithm which uses boundary representation instead of voxel labels to incorporate high-level organ shape knowledge. We propose a contour segmentation network with a multi-scale feature extraction backbone to improve the boundary detection accuracy. We also developed a contour-based human-intervention method to facilitate easy adjustments of organ boundaries. By combining the contour-based segmentation network and the contour-adjustment intervention method, our algorithm achieves fast few-shot learning and efficient human proofreading. Results: For validation, two human operators independently annotated four abdominal organs in computed tomography (CT) images using our method and two compared methods, i.e. a traditional contour-interpolation method and a state-of-the-art (SOTA) convolutional network (CNN) method based on voxel label representation. Compared to these methods, our approach considerably saved annotation time and reduced inter-rater variabilities. Our contour detection network also outperforms the SOTA nnU-Net in producing anatomically plausible organ shape with only a small training set. Conclusion: Taking advantage of the boundary shape prior and the contour representation, our method is more efficient, more accurate and less prone to inter-operator variability than the SOTA AID methods for organ segmentation from volumetric medical images. The good shape learning ability and flexible boundary adjustment function make it suitable for fast annotation of organ structures with regular shape.

Hybrid Intelligent-Annotation Organ Segmentation on Medical Datasets

Segmentation of liver and spleen based on computational anatomy models

A Robust and Explainable Structure-Based Algorithm for Detecting the Organ Boundary from Ultrasound Multi-Datasets

Intelligent contour extraction approach for accurate segmentation of medical ultrasound images

Coarse-to-fine Tuning Knowledgeable System for Boundary Delineation in Medical Images

Efficient contour-based annotation by iterative deep learning for organ segmentation from volumetric medical images

Simultaneous Segmentation of Fetal Hearts and Lungs for Medical Ultrasound Images Via an Efficient Multi-scale Model Integrated with Attention Mechanism

Optimal strategies for modeling anatomy in a hybrid intelligence framework for auto-segmentation of organs

A Multi-Center Study of Ultrasound Images using a Fully Automated Segmentation Architecture

Two-Stage Hybrid Supervision Framework for Fast, Low-resource, and Accurate Organ and Pan-cancer Segmentation in Abdomen CT

Multi-organ segmentation: a progressive exploration of learning paradigms under scarce annotation

Ultrasound Nodule Segmentation Using Asymmetric Learning with Simple Clinical Annotation

Multi-organ Segmentation over Partially Labeled Datasets with Multi-scale Feature Abstraction

Automatic Abdominal Multi-Organ Segmentation Using Deep Convolutional Neural Network and Time-Implicit Level Sets

Shape-Aware Organ Segmentation by Predicting Signed Distance Maps

Annotation-efficient deep learning for automatic medical image segmentation

Effective hybrid attention network based on pseudo-color enhancement in ultrasound image segmentation

AttentionAnatomy: A Unified Framework for Whole-Body Organs at Risk Segmentation Using Multiple Partially Annotated Datasets.

Generalized Organ Segmentation by Imitating One-shot Reasoning using Anatomical Correlation

A Hybrid Enhanced Attention Transformer Network for Medical Ultrasound Image Segmentation

Interactive segmentation of medical images using deep learning