Abstract:Accurate and robust segmentation of abdominal organs on CT is essential for many clinical applications such as computer-aided diagnosis and computer-aided surgery. But this task is challenging due to the weak boundaries of organs, the complexity of the background, and the variable sizes of different organs. To address these challenges, we introduce a novel framework for multi-organ segmentation of abdominal regions by using organ-attention networks with reverse connections (OAN-RCs) which are applied to 2D views, of the 3D CT volume, and output estimates which are combined by statistical fusion exploiting structural similarity. More specifically, OAN is a two-stage deep convolutional network, where deep network features from the first stage are combined with the original image, in a second stage, to reduce the complex background and enhance the discriminative information for the target organs. Intuitively, OAN reduces the effect of the complex background by focusing attention so that each organ only needs to be discriminated from its local background. RCs are added to the first stage to give the lower layers more semantic information thereby enabling them to adapt to the sizes of different organs. Our networks are trained on 2D views (slices) enabling us to use holistic information and allowing efficient computation (compared to using 3D patches). To compensate for the limited cross-sectional information of the original 3D volumetric CT, e.g., the connectivity between neighbor slices, multi-sectional images are reconstructed from the three different 2D view directions. Then we combine the segmentation results from the different views using statistical fusion, with a novel term relating the structural similarity of the 2D views to the original 3D structure. To train the network and evaluate results, 13 structures were manually annotated by four human raters and confirmed by a senior expert on 236 normal cases. We tested our algorithm by 4-fold cross-validation and computed Dice-Sorensen similarity coefficients (DSC) and surface distances for evaluating our estimates of the 13 structures. Our experiments show that the proposed approach gives strong results and outperforms 2D- and 3D-patch based state-of-the-art methods in terms of DSC and mean surface distances. (C) 2019 Published by Elsevier B.V.

Learning Consistency- and Discrepancy-Context for 2D Organ Segmentation

3D Multiple-Contextual ROI-Attention Network for Efficient and Accurate Volumetric Medical Image Segmentation.

Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D Networks for 3D Coherent Layer Segmentation of Retinal OCT Images with Full and Annotations

Interactive Liver Segmentation in CT Volumes Using Fully Convolutional Networks.

Residual Inter-slice Feature Learning for 3D Organ Segmentation.

Improving the Slice Interaction of 2.5D CNN for Automatic Pancreas Segmentation.

Scribble-based 3D Multiple Abdominal Organ Segmentation via Triple-branch Multi-dilated Network with Pixel- and Class-wise Consistency

A 2.5D semantic segmentation of the pancreas using attention guided dual context embedded U-Net

Spatial Context-Aware Self-Attention Model For Multi-Organ Segmentation

Abdominal Multi-Organ Segmentation with Organ-Attention Networks and Statistical Fusion

Efficient Context-Aware Network for Abdominal Multi-organ Segmentation

Continual Segment: Towards a Single, Unified and Accessible Continual Segmentation Model of 143 Whole-body Organs in CT Scans

Efficient Multi-Organ Segmentation from 3D Abdominal CT Images with Lightweight Network and Knowledge Distillation.

Contextual Embedding Learning to Enhance 2D Networks for Volumetric Image Segmentation

Recurrent Feature Propagation and Edge Skip-Connections for Automatic Abdominal Organ Segmentation

Semi-supervised Abdominal Multi-organ Segmentation Via Contour Aware Dual-Task Consistency

A Lightweight Network for Abdominal Multi-Organ Segmentation Based on Multi-Scale Context Fusion and Dual Self-Attention

Enhancing Single-Slice Segmentation with 3D-to-2D Unpaired Scan Distillation

Continual Learning for Abdominal Multi-Organ and Tumor Segmentation

Cross-slice Context Consistency for Semi-supervised 3D Left Atrium Segmentation.

Liver segmentation using 3D CNNs with high level shape constraints