Abstract:Segmentation of rectal cancerous regions from Magnetic Resonance (MR) images can help doctor define the extent of the rectal cancer and judge the severity of rectal cancer, so rectal tumor segmentation is crucial to improve the accuracy of rectal cancer diagnosis. However, accurate segmentation of rectal cancerous regions remains a challenging task due to the shape of rectal tumor has significant variations and the tumor and surrounding tissue are indistinguishable. In addition, in the early research on rectal tumor segmentation, most deep learning methods were based on convolutional neural networks (CNNs), and traditional CNN have small receptive field, which can only capture local information while ignoring the global information of the image. Nevertheless, the global information plays a crucial role in rectal tumor segmentation, so traditional CNN-based methods usually cannot achieve satisfactory segmentation results. In this paper, we propose an encoder-decoder network named Dual Parallel Net (DuPNet), which fuses transformer and classical CNN for capturing both global and local information. Meanwhile, as for capture features at different scales as well as to avoid accuracy loss and parameters reduction, we design a feature adaptive block (FAB) in skip connection between encoder and decoder. Furthermore, in order to utilize the apriori information of rectal tumor shape effectively, we design a Gaussian Mixture prior and embed it in self-attention mechanism of the transformer, leading to robust feature representation and accurate segmentation results. We have performed extensive ablation experiments to verify the effectiveness of our proposed dual parallel encoder, FAB and Gaussian Mixture prior on the dataset from the Shanxi Cancer Hospital. In the experimental comparison with the state-of-the-art methods, our method achieved a Mean Intersection over Union (MIoU) of 89.34% on the test set. In addition to that, we evaluated the generalizability of our method on the dataset from Xinhua Hospital, the promising results verify the superiority of our method.

DLGNet: A dual-branch lesion-aware network with the supervised Gaussian Mixture model for colon lesions classification in colonoscopy images

Residual Convolutional Neural Networks With Global And Local Pathways For Classification Of Focal Liver Lesions

CasCRNN-GL-Net: Cascaded Convolutional and Recurrent Neural Networks with Global and Local Pathways for Classification of Focal Liver Lesions in Multi-Phase CT Images

GCLDNet: Gastric Cancer Lesion Detection Network Combining Level Feature Aggregation and Attention Feature Fusion

A Cascade Attention Network for Liver Lesion Classification in Weakly-Labeled Multi-phase CT Images.

Deep Learning for Classification and Localization of Early Gastric Cancer in Endoscopic Images.

Dganet: a dual global attention neural network for breast lesion detection in ultrasound images

IPNet: An Interpretable Network with Progressive Loss for Whole-stage Colorectal Disease Diagnosis

Dual Resolution Deep Learning Network with Self-Attention Mechanism for Classification and Localisation of Colorectal Cancer in Histopathological Images

Computer-aided Detection and Prognosis of Colorectal Cancer on Whole Slide Images Using Dual Resolution Deep Learning

MLMSA: Multi-Level and Multi-Scale Attention for Lesion Detection in Endoscopy

Discriminative Cervical Lesion Detection in Colposcopic Images With Global Class Activation and Local Bin Excitation

Non-Local Attention and Densely-Connected Convolutional Neural Networks for Malignancy Suspiciousness Classification of Gastric Ulcer

Supervised Contrastive Learning for Gastrointestinal Lesions Classification in Endoscopic Images

Multi-Scale Context-Guided Deep Network for Automated Lesion Segmentation With Endoscopy Images of Gastrointestinal Tract

Dual-guided network for endoscopic image segmentation with region and boundary cues

MLANet: Multi-Layer Anchor-free Network for generic lesion detection

Dual-branch hybrid network for lesion segmentation in gastric cancer images

Dual Parallel Net: A Novel Deep Learning Model for Rectal Tumor Segmentation Via CNN and Transformer with Gaussian Mixture Prior

LGDNet: local feature coupling global representations network for pulmonary nodules detection

Dual-modality Image Feature Fusion Network for Gastric Precancerous Lesions Classification.