An Effective MR-Guided CT Network Training for Segmenting Prostate in CT Images

Wanqi Yang,Yinghuan Shi,Sang Hyun Park,Ming Yang,Yang Gao,Dinggang Shen

DOI: https://doi.org/10.1109/jbhi.2019.2960153

IF: 7.7

2020-08-01

IEEE Journal of Biomedical and Health Informatics

Abstract:Segmentation of prostate in medical imaging data (e.g., CT, MRI, TRUS) is often considered as a critical yet challenging task for radiotherapy treatment. It is relatively easier to segment prostate from MR images than from CT images, due to better soft tissue contrast of the MR images. For segmenting prostate from CT images, most previous methods mainly used CT alone, and thus their performances are often limited by low tissue contrast in the CT images. In this article, we explore the possibility of using indirect guidance from MR images for improving prostate segmentation in the CT images. In particular, we propose a novel deep transfer learning approach, i.e., MR-guided CT network training (namely MICS-NET), which can employ MR images to help better learning of features in CT images for prostate segmentation. In MICS-NET, the guidance from MRI consists of two steps: (1) learning informative and transferable features from MRI and then transferring them to CT images in a cascade manner, and (2) adaptively transferring the prostate likelihood of MRI model (i.e., well-trained convnet by purely using MR images) with a view consistency constraint. To illustrate the effectiveness of our approach, we evaluate MICS-NET on a real CT prostate image set, with the manual delineations available as the ground truth for evaluation. Our methods generate promising segmentation results which achieve (1) six percentages higher Dice Ratio than the CT model purely using CT images and (2) comparable performance with the MRI model purely using MR images.

computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the challenge of prostate segmentation in CT images. Due to the low contrast between the prostate and the surrounding soft tissues in CT images, it is very difficult to directly segment the prostate from CT images. Although it is relatively easy to segment the prostate from MRI images because MRI images have better soft - tissue contrast, radiotherapy requires dose planning based on CT images. Therefore, this paper explores the possibility of using indirect MRI - image guidance to improve prostate segmentation in CT images. Specifically, the paper proposes a new deep transfer - learning method - MR - guided CT network training (MICS - NET), which can use MRI images to assist in prostate segmentation in CT images during the training stage. The main steps of MICS - NET include: 1. **Cascade feature transfer from MRI to CT images**: By constructing a series of continuously changing images from MRI to CT images, gradually transfer the useful features in MRI images to CT images. 2. **Prostate - likelihood transfer under view - consistency constraints**: By introducing view - consistency constraints between MRI and CT models, adaptively transfer the prostate - likelihood information in the MRI model to further update the CT model. Through these methods, MICS - NET can perform prostate segmentation using only CT images during the test stage without any MRI images, thereby improving the accuracy of prostate segmentation in CT images. Experimental results show that compared with the method using only CT images, MICS - NET has a 6 - percentage - point increase in Dice Ratio and is comparable in performance to the method using only MRI images.

An Effective MR-Guided CT Network Training for Segmenting Prostate in CT Images

CT Prostate Segmentation Based on Synthetic MRI-aided Deep Attention Fully Convolution Network.

Multi-scale discriminative network for prostate cancer lesion segmentation in multiparametric MR images

3D Multi-Scale Discriminative Network with Multi-Directional Edge Loss for Prostate Zonal Segmentation in Bi-Parametric MR Images

Attention-guided multi-scale learning network for automatic prostate and tumor segmentation on MRI

Automatic Segmentation of Prostate Magnetic Resonance Imaging Using Generative Adversarial Networks

A Novel Residual and Gated Network for Prostate Segmentation on MR Images.

Male Pelvic CT Multi-Organ Segmentation Using Synthetic MRI-aided Dual Pyramid Networks

Segmentation of the Prostatic Gland and the Intraprostatic Lesions on Multiparametic MRI Using Mask-RCNN

Achieving accurate prostate auto-segmentation on CT in the absence of MR imaging

A Combined Learning Algorithm for Prostate Segmentation on 3D CT Images

Multi-organ Segmentation in Pelvic CT Images with CT-based Synthetic MRI

Automated Cervical Tumor Segmentation on MR Images Using Multi-View Feature Attention Network

CDA-Net: A Contrastive Deep Adversarial Model for Prostate Cancer Segmentation in MRI Images.

Automatic Segmentation of Prostate Structures Using a Convolutional Neural Network from Multiparametric MRI

A Novel Image-Specific Transfer Approach for Prostate Segmentation in MR Images

Deep generative model-driven multimodal prostate segmentation in radiotherapy

A Learning-Based CT Prostate Segmentation Method Via Joint Transductive Feature Selection and Regression

Automatic Segmentation of the Prostate on CT Images Using Deep Learning and Multi-Atlas Fusion

Deep Convolutional Neural Network for Prostate Mr Segmentation

Automatic MRI Prostate Segmentation Using 3D Deeply Supervised FCN with Concatenated Atrous Convolution