Abstract:Accurate and automatic organ segmentation from 3D radiological scans is an important yet challenging problem for medical image analysis. Specifically, as a small, soft, and flexible abdominal organ, the pancreas demonstrates very high inter-patient anatomical variability in both its shape and volume. This inhibits traditional automated segmentation methods from achieving high accuracies, especially compared to the performance obtained for other organs, such as the liver, heart or kidneys. To fill this gap, we present an automated system from 3D computed tomography (CT) volumes that is based on a two-stage cascaded approach-pancreas localization and pancreas segmentation. For the first step, we localize the pancreas from the entire 3D CT scan, providing a reliable bounding box for the more refined segmentation step. We introduce a fully deep-learning approach, based on an efficient application of holistically-nested convolutional networks (HNNs) on the three orthogonal axial, sagittal, and coronal views. The resulting HNN per-pixel probability maps are then fused using pooling to reliably produce a 3D bounding box of the pancreas that maximizes the recall. We show that our introduced localizer compares favorably to both a conventional non-deep-learning method and a recent hybrid approach based on spatial aggregation of superpixels using random forest classification. The second, segmentation, phase operates within the computed bounding box and integrates semantic mid-level cues of deeply-learned organ interior and boundary maps, obtained by two additional and separate realizations of HNNs. By integrating these two mid-level cues, our method is capable of generating boundary-preserving pixel-wise class label maps that result in the final pancreas segmentation. Quantitative evaluation is performed on a publicly available dataset of 82 patient CT scans using 4-fold cross-validation (CV). We achieve a (mean  ±  std. dev.) Dice similarity coefficient (DSC) of 81.27 ± 6.27% in validation, which significantly outperforms both a previous state-of-the art method and a preliminary version of this work that report DSCs of 71.80 ± 10.70% and 78.01 ± 8.20%, respectively, using the same dataset.

Optimize multiscale feature hybrid-net deep learning approach used for automatic pancreas image segmentation

DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation

Deep convolutional networks for pancreas segmentation in CT imaging

Harnessing 2D Networks and 3D Features for Automated Pancreas Segmentation from Volumetric CT Images

Detection and Segmentation of Pancreas using Morphological Snakes and Deep Convolutional Neural Networks

Spatial aggregation of holistically-nested convolutional neural networks for automated pancreas localization and segmentation

Efficient, high-performance pancreatic segmentation using multi-scale feature extraction

Fully Automated Pancreas Segmentation with Two-stage 3D Convolutional Neural Networks

An optimized two stage U-Net approach for segmentation of pancreas and pancreatic tumor

A Two-Stage Data-Model Driven Pancreas Segmentation Strategy Embedding Directional Information of the Boundary Intensity Gradient and Deep Adaptive Pointwise Parameters.

Multi-scale U-like network with attention mechanism for automatic pancreas segmentation

Cascaded MultiTask 3-D Fully Convolutional Networks for Pancreas Segmentation

MDHT-Net: Multi-scale Deformable U-Net with Cos-spatial and Channel Hybrid Transformer for pancreas segmentation

Automated pancreas segmentation and volumetry using deep neural network on computed tomography

Improving the Slice Interaction of 2.5D CNN for Automatic Pancreas Segmentation.

Automatic multi-tissue segmentation in pancreatic pathological images with selected multi-scale attention network

Attention-enhanced multiscale feature fusion network for pancreas and tumor segmentation

Semantic segmentation of pancreatic medical images by using convolutional neural network

3D Dense Volumetric Network for Accurate Automated Pancreas Segmentation

Pancreas Segmentation Via Spatial Context Based U-net and Bidirectional LSTM.

Automatic Pancreas Segmentation Using Coarse-Scaled 2D Model of Deep Learning: Usefulness of Data Augmentation and Deep U-Net