Abstract:Purpose: Propagation of contours from high-quality magnetic resonance (MR) images to treatment planning ultrasound (US) images with severe needle artifacts is a challenging task, which can greatly aid the organ contouring in high dose rate (HDR) prostate brachytherapy. In this study, a deep learning approach was developed to automatize this registration procedure for HDR brachytherapy practice. Methods: Because of the lack of training labels and difficulty of accurate registration from inferior image quality, a new segmentation-based registration framework was proposed for this multi-modality image registration problem. The framework consisted of two segmentation networks and a deformable registration network, based on the weakly -supervised registration strategy. Specifically, two 3D V-Nets were trained for the prostate segmentation on the MR and US images separately, to generate the weak supervision labels for the registration network training. Besides the image pair, the corresponding prostate probability maps from the segmentation were further fed to the registration network to predict the deformation matrix, and an augmentation method was designed to randomly scale the input and label probability maps during the registration network training. The overlap between the deformed and fixed prostate contours was analyzed to evaluate the registration accuracy. Three datasets were collected from our institution for the MR and US image segmentation networks, and the registration network learning, which contained 121, 104, and 63 patient cases, respectively. Results: The mean Dice similarity coefficient (DSC) results of the two prostate segmentation networks are 0.86 ± 0.05 and 0.90 ± 0.03, for MR images and the US images after the needle insertion, respectively. The mean DSC, center-of-mass (COM) distance, Hausdorff distance (HD), and averaged symmetric surface distance (ASSD) results for the registration of manual prostate contours were 0.87 ± 0.05, 1.70 ± 0.89 mm, 7.21 ± 2.07 mm, 1.61 ± 0.64 mm, respectively. By providing the prostate probability map from the segmentation to the registration network, as well as applying the random map augmentation method, the evaluation results of the four metrics were all improved, such as an increase in DSC from 0.83 ± 0.08 to 0.86 ± 0.06 and from 0.86 ± 0.06 to 0.87 ± 0.05, respectively. Conclusions: A novel segmentation-based registration framework was proposed to automatically register prostate MR images to the treatment planning US images with metal artifacts, which not only largely saved the labor work on the data preparation, but also improved the registration accuracy. The evaluation results showed the potential of this approach in HDR prostate brachytherapy practice.

Feature-Based Deformable Registration Using Minimal Spanning Tree for Prostate MR Segmentation

Minimum Spanning Tree Fusing Uniform Sub-Sampling Points and High-Dimensional Features for Medical Image Registration

3D Multi-Scale Discriminative Network with Multi-Directional Edge Loss for Prostate Zonal Segmentation in Bi-Parametric MR Images

Minimum Spanning Tree Hierarchically Fusing Multi-feature Points and High-Dimensional Features for Medical Image Registration.

Prostate MR/TRUS Image Segmentation and Registration Methods Based on Supervised Learning

Minimum Spanning Tree Fusing Multi-Salient Points Hierarchically For Multi-Modality Image Registration

A Fully Automatic Multi-Atlas Based Segmentation Method for Prostate MR Images

Multi-scale discriminative network for prostate cancer lesion segmentation in multiparametric MR images

Deformable MRI-US Image Registration Using Biomechanically Constrained Shape Matching Network for Image-Guided Prostate Intervention

Weakly supervised volumetric prostate registration for MRI-TRUS image driven by signed distance map

Weakly Supervised Registration of Prostate MRI and Histopathology Images

Multimodal registration network with multi-scale feature-crossing

Minimum Spanning Tree Integrated with Gradient Information for Medical Image Registration

Patch-based Label Fusion for Automatic Multi-Atlas-based Prostate Segmentation in MR Images

Deformable MRI-TRUS Registration Using Biomechanically Constrained Deep Learning Model for Tumor-Targeted Prostate Brachytherapy

Automatic Prostate MR Image Segmentation with Sparse Label Propagation and Domain-Specific Manifold Regularization

MR to ultrasound image registration with segmentation-based learning for HDR prostate brachytherapy

3D prostate MR image segmentation: A multi-task approach

Automatic MRI Prostate Segmentation Using 3D Deeply Supervised FCN with Concatenated Atrous Convolution

TH-CD-206-02: BEST IN PHYSICS (IMAGING): 3D Prostate Segmentation in MR Images Using Patch-Based Anatomical Signature.

A Novel Registration-Based Algorithm for Prostate Segmentation Via the Combination of SSM and CNN.