Abstract:Purpose: To achieve accurate image segmentation, which is the first critical step in medical image analysis and interventions, using deep neural networks seems a promising approach provided sufficiently large and diverse annotated data from experts. However, annotated datasets are often limited because it is prone to variations in acquisition parameters and require high-level expert's knowledge, and manually labeling targets by tracing their contour is often laborious. Developing fast, interactive, and weakly supervised deep learning methods is thus highly desirable. Methods: We propose a new efficient deep learning method to accurately segment targets from images while generating an annotated dataset for deep learning methods. It involves a generative neural network-based prior-knowledge prediction from pseudo-contour landmarks. The predicted prior knowledge (i.e., contour proposal) is then refined using a convolutional neural network that leverages the information from the predicted prior knowledge and the raw input image. Our method was evaluated on a clinical database of 145 intraoperative ultrasound and 78 postoperative CT images of image-guided prostate brachytherapy. It was also evaluated on a cardiac multi-structure segmentation from 450 2D echocardiographic images. Results: Experimental results show that our model can segment the prostate clinical target volume in 0.499 s (i.e., 7.79 milliseconds per image) with an average Dice coefficient of 96.9 ± 0.9% and 95.4 ± 0.9%, 3D Hausdorff distance of 4.25 ± 4.58 and 5.17 ± 1.41 mm, and volumetric overlap ratio of 93.9 ± 1.80% and 91.3 ± 1.70 from TRUS and CT images, respectively. It also yielded an average Dice coefficient of 96.3 ± 1.3% on echocardiographic images. Conclusions: We proposed and evaluated a fast, interactive deep learning method for accurate medical image segmentation. Moreover, our approach has the potential to solve the bottleneck of deep learning methods in adapting to inter-clinical variations and speed up the annotation processes.

Fast Interactive Multi-Region Cardiac Segmentation with Linearly Ordered Labels

A Fully Automated Two-Stage Segmentation Approach for Late Gadolinium-Enhanced Cardiac Magnetic Resonance Images in Personalized Cardiac Modeling

Segmentation of Cardiac Tissues and Organs for CCTA Images Based on a Deep Learning Model

Spatiotemporal Strategies for Joint Segmentation and Motion Tracking from Cardiac Image Sequences

Fast Interactive Volume Rendering Method for Adjustable Vessel Segmentation Visualization

Segmentation of Myocardium Using Velocity Field Constrained Front Propagation

Spatio-temporal Active Region Model for Simultaneous Segmentation and Motion Estimation of the Whole Heart

Integrated 3d flow-based multi-atlas brain structure segmentation.

Myocardial Segmentation of Late Gadolinium Enhanced MR Images by Propagation of Contours from Cine MR Images

Pseudo-3D Network for Multi-sequence Cardiac MR Segmentation

An efficient interactive multi-label segmentation tool for 2D and 3D medical images using fully connected conditional random field

Efficient Cellular Automaton Segmentation Supervised by Pyramid on Medical Volumetric Data and Real Time Implementation with Graphics Processing Unit

Fast interactive medical image segmentation with weakly supervised deep learning method

A Fast 3D Region Growing Approach for CT Angiography Applications.

Automatic segmentation and implicit surface representation of dynamic cardiac data

Rapid Multi-organ Segmentation Using Context Integration and Discriminative Models.

Unsupervised Cardiac Segmentation Utilizing Synthesized Images from Anatomical Labels

Fast Organ Segmentation in CT Images with CUDA

A Parallel Cerebrovascular Segmentation Algorithm Based on Focused Multi-Gaussians Model and Heterogeneous Markov Random Field

3D Consistent & Robust Segmentation of Cardiac Images by Deep Learning with Spatial Propagation

Brain MRI Segmentation with Fast and Globally Convex Multiphase Active Contours