Towards Automatic Abdominal Multi-Organ Segmentation in Dual Energy CT using Cascaded 3D Fully Convolutional Network

Shuqing Chen,Holger Roth,Sabrina Dorn,Matthias May,Alexander Cavallaro,Michael M. Lell,Marc Kachelrieß,Hirohisa Oda,Kensaku Mori,Andreas Maier

DOI: https://doi.org/10.48550/arXiv.1710.05379

2017-10-16

Abstract:Automatic multi-organ segmentation of the dual energy computed tomography (DECT) data can be beneficial for biomedical research and clinical applications. However, it is a challenging task. Recent advances in deep learning showed the feasibility to use 3-D fully convolutional networks (FCN) for voxel-wise dense predictions in single energy computed tomography (SECT). In this paper, we proposed a 3D FCN based method for automatic multi-organ segmentation in DECT. The work was based on a cascaded FCN and a general model for the major organs trained on a large set of SECT data. We preprocessed the DECT data by using linear weighting and fine-tuned the model for the DECT data. The method was evaluated using 42 torso DECT data acquired with a clinical dual-source CT system. Four abdominal organs (liver, spleen, left and right kidneys) were evaluated. Cross-validation was tested. Effect of the weight on the accuracy was researched. In all the tests, we achieved an average Dice coefficient of 93% for the liver, 90% for the spleen, 91% for the right kidney and 89% for the left kidney, respectively. The results show our method is feasible and promising.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

This paper aims to solve the problem of automatic multi - organ segmentation in dual - energy computed tomography (DECT). Specifically, the authors propose a method based on cascaded 3D fully convolutional networks (FCN) for automatically segmenting multiple abdominal organs in DECT images. The proposal of this method mainly addresses the following challenges: 1. **Inter - individual differences in the human abdomen**: There are significant differences in the abdominal anatomical structures among different individuals. 2. **Complex 3D intra - individual variations**: There are complex three - dimensional structural differences among different organs within the same human body. 3. **Soft - tissue deformation**: During the imaging process, soft tissues may be deformed. 4. **The same organ has different HU values under different spectra**: Due to the use of different X - ray energy spectra, the Hounsfield unit (HU) values of the same organ may be different under different spectra. To address these challenges, the authors utilize deep - learning techniques, especially 3D fully convolutional networks (FCN), and achieve automatic multi - organ segmentation of DECT data through the following steps: - **Pre - processing**: Generate a mixed image by linearly weighted mixing of low - energy and high - energy images. - **Binary mask generation**: Generate a binary mask of the skin contour by thresholding the mixed image. - **Multi - channel input**: Feed the mixed image, binary mask and label image as multi - channel input into the network. - **Two - stage cascaded network**: The first stage generates the region of interest (ROI) to reduce the search space in the second stage; the second stage makes the final segmentation prediction. The experimental results show that this method performs well in the segmentation of the liver, spleen, right kidney and left kidney, with average Dice coefficients of 92%, 84%, 88% and 87% respectively, demonstrating the effectiveness and robustness of this method. In addition, the authors also study the influence of different weights α on the segmentation accuracy and find that different organs may require different optimal α values.

Towards Automatic Abdominal Multi-Organ Segmentation in Dual Energy CT using Cascaded 3D Fully Convolutional Network

Improving Generalization Capability of Multiorgan Segmentation Models Using Dual-Energy CT

Head and neck multi-organ segmentation on dual-energy CT using dual pyramid convolutional neural networks

A multi-scale pyramid of 3D fully convolutional networks for abdominal multi-organ segmentation

Automatic Abdominal Multi-Organ Segmentation Using Deep Convolutional Neural Network and Time-Implicit Level Sets

Fully-automated multi-organ segmentation tool applicable to both non-contrast and post-contrast abdominal CT: deep learning algorithm developed using dual-energy CT images

Multi-Dimensional Cascaded Net with Uncertain Probability Reduction for Abdominal Multi-Organ Segmentation in CT Sequences

Abdominal Multi-Organ Segmentation with Organ-Attention Networks and Statistical Fusion

An efficient two-step multi-organ registration on abdominal CT via deep-learning based segmentation

An application of cascaded 3D fully convolutional networks for medical image segmentation

Automatic Multi-Organ Segmentation from Abdominal CT Volumes with LLE-based Graph Partitioning and 3D Chan-Vese Model

A Multiorgan Segmentation Model for CT Volumes Via Full Convolution-Deconvolution Network.

Robust and Efficient Abdominal CT Segmentation Using Shape Constrained Multi-Scale Attention Network

Incorporating the hybrid deformable model for improving the performance of abdominal CT segmentation via multi-scale feature fusion network

Improved Abdominal Multi-Organ Segmentation via 3D Boundary-Constrained Deep Neural Networks

Multi-organ segmentation network for abdominal CT images based on spatial attention and deformable convolution

Abdominal multi-organ segmentation with cascaded convolutional and adversarial deep networks

Abdominal Organs Segmentation Based on Multi-path Fully Convolutional Network and Random Forests

Dual Knowledge‐guided Two‐stage Model for Precise Small Organ Segmentation in Abdominal CT Images

Efficient Multi-Organ Segmentation from 3D Abdominal CT Images with Lightweight Network and Knowledge Distillation.

Towards Automatic Abdominal MRI Organ Segmentation: Leveraging Synthesized Data Generated From CT Labels