Abstract:Background and objective: Segmentation of rectal cancerous regions using 2D Magnetic Resonance Imaging (MRI) images is a critical step in radiation therapy. The shape of rectal cancer has significant variations and the shape of some surrounding organs is similar to that of rectal cancer; these conditions significantly affect the segmentation accuracy of rectal cancer and lead to incorrect segmentation. Therefore, automatic segmentation of rectal cancer is urgently needed, and it is a great challenge. For this task, the existing deep learning-based approaches have two shortcomings: 1) The U-Net network plays an important role in the field of medical segmentation. However, the designs of encoders and decoders in traditional U-Net networks are relatively simple and cannot extract good features, resulting in incorrect segmentation results. 2) Conventional neural networks extract high-level features that often do not include sufficient high-resolution contour information, resulting in ambiguity in contour segmentation. In this paper, we propose an improved U-Net network based on contour prediction, aiming at effective segmentation of rectal cancer. Methods: We designed a new U-Net network by improving the traditional U-Net network. We made four improvements: 1) We replaced the encoders with the SENet network. 2) A global pooling layer was added after the last encoder. 3) We added the Spatial and Channel Squeeze & Excitation (SCSE) attention mechanism module to each decoder. 4) We concatenated the output results of each decoder. In addition, the model implemented content segmentation and contour segmentation for rectal cancer in parallel, so that both the content and contour information was learned by the network to enhance the segmentation accuracy. Results: Our data were obtained from the Shanxi Provincial Cancer Hospital and included 3773 2D MRI rectal cancer images. The proposed method achieved an Mean Intersection over Union of 0.894 (MIoU) on the test set. Compared with state-of-the-art methods, our method had the best performance on the test set, and its MIoU metric was 0.123 higher than that of the second-best model. At the same time, the effectiveness of the improvements to our method was demonstrated through ablation experiments. Conclusions: Our method can help radiologists to segment effectively, save their time and energy, and enable them to focus on cases that are not easily segmented because of the complex shape of rectal cancer.

CT images segmentation method of rectal tumor based on modified U-net

CT Image Segmentation of Rectal Tumor Based on U-Net Network

Image Segmentation of Rectal Tumor Based on Improved U-Net Model with Deep Learning.

Prostate Ultrasound Image Segmentation Based on DSU-Net

Improved U-Net based on contour prediction for efficient segmentation of rectal cancer

Imaging segmentation mechanism for rectal tumors using improved U-Net

Automatic segmentation of rectal tumors from MRI using multiscale densely connected convolutional neural network based on attention mechanism

Colorectal Tumor Segmentation of CT Scans Based on a Convolutional Neural Network with an Attention Mechanism

A Robust Segmentation Method Based on Improved U-Net

Automatic Segmentation of Rectal Tumor on Diffusion‐weighted Images by Deep Learning with U‐Net

Rectal Carcinoma Segmentation Based On Image Pre-processing and Improved U-Net with Residual Block

Residual UNet with spatial and channel attention for automatic magnetic resonance image segmentation of rectal cancer

RTAU-Net: A novel 3D rectal tumor segmentation model based on dual path fusion and attentional guidance

A 3D Renal Tumor Image Segmentation Method Based on U2-Net

Segmentation of the prostate and organs at risk in male pelvic CT images using deep learning

Technical Note: A deep learning based auto segmentation of rectal tumors in MR images.

AttU-NET: Attention U-Net for Brain Tumor Segmentation

DPA‐UNet rectal cancer image segmentation based on visual attention

Lung computed tomography image segmentation based on U-Net network fused with dilated convolution

RMAU-Net: Residual Multi-Scale Attention U-Net For liver and tumor segmentation in CT images

Tumor Segmentation in Breast Ultrasound Image by Means of Res Path Combined with Dense Connection Neural Network