Abstract:Purpose To create a network which fully utilizes multi-sequence MRI and compares favorably with manual human contouring. Methods We retrospectively collected 89 MRI studies of the pelvic cavity from patients with prostate cancer and cervical cancer. The dataset contained 89 samples from 87 patients with a total of 84 valid samples. MRI was performed with T1-weighted (T1), T2-weighted (T2), and Enhanced Dixon T1-weighted (T1DIXONC) sequences. There were two cohorts. The training cohort contained 55 samples and the testing cohort contained 29 samples. The MRI images in the training cohort contained contouring data from radiotherapist alpha. The MRI images in the testing cohort contained contouring data from radiotherapist alpha and contouring data from another radiotherapist: radiotherapist beta. The training cohort was used to optimize the convolution neural networks, which included the attention mechanism through the proposed activation module and the blended module into multiple MRI sequences, to perform autodelineation. The testing cohort was used to assess the networks' autodelineation performance. The contoured organs at risk (OAR) were the anal canal, bladder, rectum, femoral head (L), and femoral head (R). Results We compared our proposed network with UNet and FuseUNet using our dataset. When T1 was the main sequence, we input three sequences to segment five organs and evaluated the results using four metrics: the DSC (Dice similarity coefficient), the JSC (Jaccard similarity coefficient), the ASD (average mean distance), and the 95% HD (robust Hausdorff distance). The proposed network achieved improved results compared with the baselines among all metrics. The DSC were 0.834 +/- 0.029, 0.818 +/- 0.037, and 0.808 +/- 0.050 for our proposed network, FuseUNet, and UNet, respectively. The 95% HD were 7.256 +/- 2.748 mm, 8.404 +/- 3.297 mm, and 8.951 +/- 4.798 mm for our proposed network, FuseUNet, and UNet, respectively. Our proposed network also had superior performance on the JSC and ASD coefficients. Conclusion Our proposed activation module and blended module significantly improved the performance of FuseUNet for multi-sequence MRI segmentation. Our proposed network integrated multiple MRI sequences efficiently and autosegmented OAR rapidly and accurately. We also discovered that three-sequence fusion (T1-T1DIXONC-T2) was superior to two-sequence fusion (T1-T2 and T1-T1DIXONC, respectively). We infer that the more MRI sequences fused, the better the automatic segmentation results.

Incorporating the hybrid deformable model for improving the performance of abdominal CT segmentation via multi-scale feature fusion network

DeU-Net 2.0: Enhanced deformable U-Net for 3D cardiac cine MRI segmentation

Multi-organ segmentation network for abdominal CT images based on spatial attention and deformable convolution

Improving Generalization Capability of Multiorgan Segmentation Models Using Dual-Energy CT

Towards Automatic Abdominal Multi-Organ Segmentation in Dual Energy CT using Cascaded 3D Fully Convolutional Network

An efficient two-step multi-organ registration on abdominal CT via deep-learning based segmentation

Multi-Dimensional Cascaded Net with Uncertain Probability Reduction for Abdominal Multi-Organ Segmentation in CT Sequences

Attention-enhanced multiscale feature fusion network for pancreas and tumor segmentation

CT image organ segmentation method based on convolutional neural network multi-dimensional fusion

Improved Abdominal Multi-Organ Segmentation via 3D Boundary-Constrained Deep Neural Networks

Automatic Abdominal Multi-Organ Segmentation Using Deep Convolutional Neural Network and Time-Implicit Level Sets

HCT-Unet: multi-target medical image segmentation via a hybrid CNN-transformer Unet incorporating multi-axis gated multi-layer perceptron

Anatomy-guided Multi-View Fusion Framework for Abdominal CT Multi-Organ Segmentation.

A multi-scale pyramid of 3D fully convolutional networks for abdominal multi-organ segmentation

A 2.5D multi-path fusion network framework with focusing on z-axis 3D joint for medical image segmentation

Dual encoder network with transformer-CNN for multi-organ segmentation

Dual Knowledge‐guided Two‐stage Model for Precise Small Organ Segmentation in Abdominal CT Images

Hybrid transformer-CNN with boundary-awareness network for 3D medical image segmentation

Anatomically Constrained and Attention-Guided Deep Feature Fusion for Joint Segmentation and Deformable Medical Image Registration.

An Improved Combination of Faster R-CNN and U-Net Network for Accurate Multi-Modality Whole Heart Segmentation

Integrating Multiple MRI Sequences for Pelvic Organs Segmentation Via the Attention Mechanism.