Abstract:Purpose: To achieve accurate image segmentation, which is the first critical step in medical image analysis and interventions, using deep neural networks seems a promising approach provided sufficiently large and diverse annotated data from experts. However, annotated datasets are often limited because it is prone to variations in acquisition parameters and require high-level expert's knowledge, and manually labeling targets by tracing their contour is often laborious. Developing fast, interactive, and weakly supervised deep learning methods is thus highly desirable. Methods: We propose a new efficient deep learning method to accurately segment targets from images while generating an annotated dataset for deep learning methods. It involves a generative neural network-based prior-knowledge prediction from pseudo-contour landmarks. The predicted prior knowledge (i.e., contour proposal) is then refined using a convolutional neural network that leverages the information from the predicted prior knowledge and the raw input image. Our method was evaluated on a clinical database of 145 intraoperative ultrasound and 78 postoperative CT images of image-guided prostate brachytherapy. It was also evaluated on a cardiac multi-structure segmentation from 450 2D echocardiographic images. Results: Experimental results show that our model can segment the prostate clinical target volume in 0.499 s (i.e., 7.79 milliseconds per image) with an average Dice coefficient of 96.9 ± 0.9% and 95.4 ± 0.9%, 3D Hausdorff distance of 4.25 ± 4.58 and 5.17 ± 1.41 mm, and volumetric overlap ratio of 93.9 ± 1.80% and 91.3 ± 1.70 from TRUS and CT images, respectively. It also yielded an average Dice coefficient of 96.3 ± 1.3% on echocardiographic images. Conclusions: We proposed and evaluated a fast, interactive deep learning method for accurate medical image segmentation. Moreover, our approach has the potential to solve the bottleneck of deep learning methods in adapting to inter-clinical variations and speed up the annotation processes.

How to select slices for annotation to train best-performing deep learning segmentation models for cross-sectional medical images?

Sparse annotation strategies for segmentation of short axis cardiac MRI

A sparse annotation strategy based on attention-guided active learning for 3D medical image segmentation

An Annotation Sparsification Strategy for 3D Medical Image Segmentation via Representative Selection and Self-Training

How to Efficiently Annotate Images for Best-Performing Deep Learning Based Segmentation Models: An Empirical Study with Weak and Noisy Annotations and Segment Anything Model

OneSeg: Self-learning and One-shot Learning based Single-slice Annotation for 3D Medical Image Segmentation

Progressive Medical Image Annotation with Convolutional Neural Network-Based Interactive Segmentation Method

Annotation Cost Minimization for Ultrasound Image Segmentation Using Cross-domain Transfer Learning.

HAL-IA: A Hybrid Active Learning framework using Interactive Annotation for medical image segmentation

Collaborative Learning for Annotation-Efficient Volumetric MR Image Segmentation

Going to Extremes: Weakly Supervised Medical Image Segmentation

Guidelines for Cerebrovascular Segmentation: Managing Imperfect Annotations in the context of Semi-Supervised Learning

Multi-Mode Interactive Image Segmentation

Less is More: Unsupervised Mask-guided Annotated CT Image Synthesis with Minimum Manual Segmentations

Partial annotations for the segmentation of large structures with low annotation cost

Interactive segmentation of medical images using deep learning

Uncertainty-Aware Deep Learning with Cross-Task Supervision for PHE Segmentation on CT Images

Segment Anything Model for Medical Image Analysis: an Experimental Study

Fast interactive medical image segmentation with weakly supervised deep learning method

Anatomy Segmentation Evaluation with Sparse Ground Truth Data.

SDC-UDA: Volumetric Unsupervised Domain Adaptation Framework for Slice-Direction Continuous Cross-Modality Medical Image Segmentation