Abstract:Background and objective: Segmentation of rectal cancerous regions using 2D Magnetic Resonance Imaging (MRI) images is a critical step in radiation therapy. The shape of rectal cancer has significant variations and the shape of some surrounding organs is similar to that of rectal cancer; these conditions significantly affect the segmentation accuracy of rectal cancer and lead to incorrect segmentation. Therefore, automatic segmentation of rectal cancer is urgently needed, and it is a great challenge. For this task, the existing deep learning-based approaches have two shortcomings: 1) The U-Net network plays an important role in the field of medical segmentation. However, the designs of encoders and decoders in traditional U-Net networks are relatively simple and cannot extract good features, resulting in incorrect segmentation results. 2) Conventional neural networks extract high-level features that often do not include sufficient high-resolution contour information, resulting in ambiguity in contour segmentation. In this paper, we propose an improved U-Net network based on contour prediction, aiming at effective segmentation of rectal cancer. Methods: We designed a new U-Net network by improving the traditional U-Net network. We made four improvements: 1) We replaced the encoders with the SENet network. 2) A global pooling layer was added after the last encoder. 3) We added the Spatial and Channel Squeeze & Excitation (SCSE) attention mechanism module to each decoder. 4) We concatenated the output results of each decoder. In addition, the model implemented content segmentation and contour segmentation for rectal cancer in parallel, so that both the content and contour information was learned by the network to enhance the segmentation accuracy. Results: Our data were obtained from the Shanxi Provincial Cancer Hospital and included 3773 2D MRI rectal cancer images. The proposed method achieved an Mean Intersection over Union of 0.894 (MIoU) on the test set. Compared with state-of-the-art methods, our method had the best performance on the test set, and its MIoU metric was 0.123 higher than that of the second-best model. At the same time, the effectiveness of the improvements to our method was demonstrated through ablation experiments. Conclusions: Our method can help radiologists to segment effectively, save their time and energy, and enable them to focus on cases that are not easily segmented because of the complex shape of rectal cancer.

Improved U-Net based on contour prediction for efficient segmentation of rectal cancer

Imaging segmentation mechanism for rectal tumors using improved U-Net

Automatic segmentation of rectal tumors from MRI using multiscale densely connected convolutional neural network based on attention mechanism

Image Segmentation of Rectal Tumor Based on Improved U-Net Model with Deep Learning.

A Robust Segmentation Method Based on Improved U-Net

CT images segmentation method of rectal tumor based on modified U-net

Residual UNet with spatial and channel attention for automatic magnetic resonance image segmentation of rectal cancer

3D RoI-aware U-Net for Accurate and Efficient Colorectal Tumor Segmentation

RTAU-Net: A novel 3D rectal tumor segmentation model based on dual path fusion and attentional guidance

3-D RoI-Aware U-Net for Accurate and Efficient Colorectal Tumor Segmentation

Colorectal Tumor Segmentation of CT Scans Based on a Convolutional Neural Network with an Attention Mechanism

Attention Augmented ConvNeXt UNet For Rectal Tumour Segmentation

Automatic Segmentation of Rectal Tumor on Diffusion‐weighted Images by Deep Learning with U‐Net

Technical Note: A deep learning based auto segmentation of rectal tumors in MR images.

Covariance Self-Attention Dual Path UNet for Rectal Tumor Segmentation

MSBC-Net: Automatic rectal cancer segmentation from MR scans

A medical image segmentation method for rectal tumors based on multi‐scale feature retention and multiple attention mechanisms

Improved Prostate Biparameter Magnetic Resonance Image Segmentation Based on Def-UNet.

Segmentation of the prostate and organs at risk in male pelvic CT images using deep learning

Improved U-Net Based on Contour Attention for Efficient Segmentation of Skin Lesion

Dual Parallel Net: A Novel Deep Learning Model for Rectal Tumor Segmentation Via CNN and Transformer with Gaussian Mixture Prior