Abstract:Accurate and robust segmentation of abdominal organs on CT is essential for many clinical applications such as computer-aided diagnosis and computer-aided surgery. But this task is challenging due to the weak boundaries of organs, the complexity of the background, and the variable sizes of different organs. To address these challenges, we introduce a novel framework for multi-organ segmentation of abdominal regions by using organ-attention networks with reverse connections (OAN-RCs) which are applied to 2D views, of the 3D CT volume, and output estimates which are combined by statistical fusion exploiting structural similarity. More specifically, OAN is a two-stage deep convolutional network, where deep network features from the first stage are combined with the original image, in a second stage, to reduce the complex background and enhance the discriminative information for the target organs. Intuitively, OAN reduces the effect of the complex background by focusing attention so that each organ only needs to be discriminated from its local background. RCs are added to the first stage to give the lower layers more semantic information thereby enabling them to adapt to the sizes of different organs. Our networks are trained on 2D views (slices) enabling us to use holistic information and allowing efficient computation (compared to using 3D patches). To compensate for the limited cross-sectional information of the original 3D volumetric CT, e.g., the connectivity between neighbor slices, multi-sectional images are reconstructed from the three different 2D view directions. Then we combine the segmentation results from the different views using statistical fusion, with a novel term relating the structural similarity of the 2D views to the original 3D structure. To train the network and evaluate results, 13 structures were manually annotated by four human raters and confirmed by a senior expert on 236 normal cases. We tested our algorithm by 4-fold cross-validation and computed Dice-Sorensen similarity coefficients (DSC) and surface distances for evaluating our estimates of the 13 structures. Our experiments show that the proposed approach gives strong results and outperforms 2D- and 3D-patch based state-of-the-art methods in terms of DSC and mean surface distances. (C) 2019 Published by Elsevier B.V.

Multi-organ segmentation of abdominal structures from non-contrast and contrast enhanced CT images

CT-based Multi-Organ Segmentation Using a 3D Self-Attention U-net Network for Pancreatic Radiotherapy

Fully-automated multi-organ segmentation tool applicable to both non-contrast and post-contrast abdominal CT: deep learning algorithm developed using dual-energy CT images

Deep learning-based auto-contouring of organs/structures-at-risk for pediatric upper abdominal radiotherapy

CT-based Pancreatic Multi-organ Segmentation by a 3D Deep Attention U-Net Network

Abdominal Multi-Organ Segmentation with Organ-Attention Networks and Statistical Fusion

Synthetic CT-aided Multiorgan Segmentation for CBCT-guided Adaptive Pancreatic Radiotherapy

Region Proposal Network for Multi-Organ Segmentation in CT for Pancreatic Radiotherapy

Multi-organ segmentation network for abdominal CT images based on spatial attention and deformable convolution

Comprehensive evaluation of a deep learning model for automatic organs at risk segmentation on heterogeneous computed tomography images for abdominal radiotherapy

Comprehensive Evaluation of a Deep Learning Model for Automatic Organs-at-Risk Segmentation on Heterogeneous Computed Tomography Images for Abdominal Radiation Therapy

Segmentation of the prostate and organs at risk in male pelvic CT images using deep learning

Organ at Risk Segmentation in Head and Neck CT Images Using a Two-Stage Segmentation Framework Based on 3D U-Net

Organ-at-Risk (OAR) Segmentation in Head and Neck CT Using U-RCNN

Robust and Efficient Abdominal CT Segmentation Using Shape Constrained Multi-Scale Attention Network

A deep learning-based auto-segmentation system for organs-at-risk on whole-body computed tomography images for radiation therapy

Automatic Abdominal Multi-Organ Segmentation Using Deep Convolutional Neural Network and Time-Implicit Level Sets

A 2D dilated residual U-Net for multi-organ segmentation in thoracic CT

Fully Automated Multi-Organ Segmentation in Abdominal Magnetic Resonance Imaging with Deep Neural Networks

Multi-organ Segmentation in Pelvic CT Images with CT-based Synthetic MRI

Multi-organ Segmentation of Male Pelvic CT using Dual Attention Networks