Abstract:Accurate classification and segmentation of polyps are two important tasks in the diagnosis and treatment of colorectal cancers. Existing models perform segmentation and classification separately and do not fully make use of the correlation between the two tasks. Furthermore, polyps exhibit random regions and varying shapes and sizes, and they often share similar boundaries and backgrounds. However, existing models fail to consider these factors and thus are not robust because of their inherent limitations. To address these issues, we developed a multi-task network that performs both segmentation and classification simultaneously and can cope with the aforementioned factors effectively. Our proposed network possesses a dual-branch structure, comprising a transformer branch and a convolutional neural network (CNN) branch. This approach enhances local details within the global representation, improving both local feature awareness and global contextual understanding, thus contributing to the improved preservation of polyp-related information. Additionally, we have designed a feature interaction module (FIM) aimed at bridging the semantic gap between the two branches and facilitating the integration of diverse semantic information from both branches. This integration enables the full capture of global context information and local details related to polyps. To prevent the loss of edge detail information crucial for polyp identification, we have introduced a reverse attention boundary enhancement (RABE) module to gradually enhance edge structures and detailed information within polyp regions. Finally, we conducted extensive experiments on five publicly available datasets to evaluate the performance of our method in both polyp segmentation and classification tasks. The experimental results confirm that our proposed method outperforms other state-of-the-art methods.

Multiple Instance Learning for Detection of Polyps in Computed Tomographic Colonography Images

A New Framework for Detection of Initial Flat Polyp Candidates Based on a Dual Level Set Competition Model

Detection of Colorectal Polyps Based on Deep Learning.

Computer-Aided Colon Polyp Detection on High Resolution Colonoscopy Using Transfer Learning Techniques

Multiple Instance Learning for Computer Aided Detection and Diagnosis of Gastric Cancer with Dual-Energy CT Imaging

A Deep Ensemble Learning Method for Colorectal Polyp Classification with Optimized Network Parameters

An Ensemble Framework of Deep Neural Networks for Colorectal Polyp Classification

Adaptive Kernel Based Multiple Kernel Learning for Computer-Aided Polyp Detection in CT Colonography

A Local Region Proposals Approach to Instance Segmentation for Intestinal Polyp Detection

Automatic Polyp Detection in Colonoscopy Images: Convolutional Neural Network, Dataset and Transfer Learning

A self-attention based faster R-CNN for polyp detection from colonoscopy images

Simultaneous segmentation and classification of colon cancer polyp images using a dual branch multi-task learning network

Computer-aided detection of colonic polyps with level set-based adaptive convolution in volumetric mucosa to advance CT colonography toward a screening modality.

An Ensemble-Based Deep Convolutional Neural Network for Computer-Aided Polyps Identification From Colonoscopy

Multiple clustered instance learning for histopathology cancer image classification, segmentation and clustering

Automated Detection of Colon Polyps for CT Colonography

Massive Colonoscopy Images Oriented Polyp Detection.

An efficient real-time colonic polyp detection with YOLO algorithms trained by using negative samples and large datasets

A Deep Convolutional Neural Network for the Detection of Polyps in Colonoscopy Images

Towards a Computed-Aided Diagnosis System in Colonoscopy: Automatic Polyp Segmentation Using Convolution Neural Networks

A Novel Colonic Polyp Volume Segmentation Method For Computer Tomographic Colonography