Abstract:Purpose: Training deep neural networks usually require a large number of human-annotated data. For organ segmentation from volumetric medical images, human annotation is tedious and inefficient. To save human labour and to accelerate the training process, the strategy of annotation by iterative deep learning recently becomes popular in the research community. However, due to the lack of domain knowledge or efficient human-interaction tools, the current AID methods still suffer from long training time and high annotation burden. Methods: We develop a contour-based annotation by iterative deep learning (AID) algorithm which uses boundary representation instead of voxel labels to incorporate high-level organ shape knowledge. We propose a contour segmentation network with a multi-scale feature extraction backbone to improve the boundary detection accuracy. We also developed a contour-based human-intervention method to facilitate easy adjustments of organ boundaries. By combining the contour-based segmentation network and the contour-adjustment intervention method, our algorithm achieves fast few-shot learning and efficient human proofreading. Results: For validation, two human operators independently annotated four abdominal organs in computed tomography (CT) images using our method and two compared methods, i.e. a traditional contour-interpolation method and a state-of-the-art (SOTA) convolutional network (CNN) method based on voxel label representation. Compared to these methods, our approach considerably saved annotation time and reduced inter-rater variabilities. Our contour detection network also outperforms the SOTA nnU-Net in producing anatomically plausible organ shape with only a small training set. Conclusion: Taking advantage of the boundary shape prior and the contour representation, our method is more efficient, more accurate and less prone to inter-operator variability than the SOTA AID methods for organ segmentation from volumetric medical images. The good shape learning ability and flexible boundary adjustment function make it suitable for fast annotation of organ structures with regular shape.

A Texture Feature-Based Method for Dynamic Organ Tracking

Multi-features Guided Robust Visual Tracking.

Gastroscopic Image Graph: Application to Noninvasive Multitarget Tracking under Gastroscopy

Dynamic Target Tracking Method Based on Medical Imaging

Spatiotemporal Strategies for Joint Segmentation and Motion Tracking from Cardiac Image Sequences

Accurate 6DOF Pose Tracking for Texture-Less Objects

Tracking facial feature points using Kanade-Lucas-Tomasi approach

3D soft-tissue tracking using spatial-color joint probability distribution and thin-plate spline model.

A Direct 3D Object Tracking Method Based on Dynamic Textured Model Rendering and Extended Dense Feature Fields

Robust 3D Motion Tracking for Vision‐Based Control in Robotic Heart Surgery

WE-AB-303-08: Direct Lung Tumor Tracking Using Short Imaging Arcs

Motion Tracking for Beating Heart Based on Sparse Statistic Pose Modeling.

Efficient contour-based annotation by iterative deep learning for organ segmentation from volumetric medical images

Context Specific Descriptors for Tracking Deforming Tissue.

Reconstruction of 3D Human Motion Using Multiple View L1 Trackers

Harvesting, Detecting, and Characterizing Liver Lesions from Large-scale Multi-phase CT Data via Deep Dynamic Texture Learning

Dynamic High Resolution Deformable Articulated Tracking

Soft-Tissue Motion Tracking And Structure Estimation For Robotic Assisted Mis Procedures

Visual Feature Extraction Via Eye Tracking for Saliency Driven 2D/3D Registration.

Facetracker: A Human Face Tracking And Facial Organ Localizing System

Structure-aware Registration Network for Liver DCE-CT Images