Abstract:Purpose: Colon cancer is one of the top three diseases in gastrointestinal cancers, and colon polyps are an important trigger of colon cancer. Early diagnosis and removal of colon polyps can avoid the incidence of colon cancer. Currently, colon polyp removal surgery is mainly based on artificial-intelligence (AI) colonoscopy, supplemented by deep-learning technology to help doctors remove colon polyps. With the development of deep learning, the use of advanced AI technology to assist in medical diagnosis has become mainstream and can maximize the doctor's diagnostic time and help doctors to better formulate medical plans. Approach: We propose a deep-learning model for segmenting colon polyps. The model adopts a dual-branch structure, combines a convolutional neural network (CNN) with a transformer, and replaces ordinary convolution with deeply separable convolution based on ResNet; a stripe pooling module is introduced to obtain more effective information. The aggregated attention module (AAM) is proposed for high-dimensional semantic information, which effectively combines two different structures for the high-dimensional information fusion problem. Deep supervision and multi-scale training are added in the model training process to enhance the learning effect and generalization performance of the model. Results: The experimental results show that the proposed dual-branch structure is significantly better than the single-branch structure, and the model using the AAM has a significant performance improvement over the model not using the AAM. Our model leads 1.1% and 1.5% in mIoU and mDice, respectively, when compared with state-of-the-art models in a fivefold cross-validation on the Kvasir-SEG dataset. Conclusions: We propose and validate a deep learning model for segmenting colon polyps, using a dual-branch network structure. Our results demonstrate the feasibility of complementing traditional CNNs and transformer with each other. And we verified the feasibility of fusing different structures on high-dimensional semantics and successfully retained the high-dimensional information of different structures effectively.

Detection of Serrated Adenoma in NBI Based on Multi-Scale Sub-Pixel Convolution

Computer-aided diagnosis of serrated colorectal lesions using non-magnified white-light endoscopic images

Multi-scale and Multi-path Cascaded Convolutional Network for Semantic Segmentation of Colorectal Polyps

An Adaptive Regularization Approach to Colonoscopic Polyp Detection Using a Cascaded Structure of Encoder–Decoders

Towards a Computed-Aided Diagnosis System in Colonoscopy: Automatic Polyp Segmentation Using Convolution Neural Networks

A Deep Convolutional Neural Network for the Detection of Polyps in Colonoscopy Images

AI based colorectal disease detection using real-time screening colonoscopy

Multi-scale Features Fusion Based Rectal Polyps Detection

Automatic Polyp Segmentation in Colonoscopy Images Using a Modified Deep Convolutional Encoder-Decoder Architecture

Flexible Colon Polyp Detection: A Dual Mode Approach for Detection and Segmentation of Colon Polyps with Optional Inpainting for Specular Highlight Mitigation

ColoRectalCADx: Expeditious Recognition of Colorectal Cancer with Integrated Convolutional Neural Networks and Visual Explanations Using Mixed Dataset Evidence

[Colon polyp detection based on multi-scale and multi-level feature fusion and lightweight convolutional neural network]

Multi-Dimensional Fusion Reverse Attention Network for Polyp Segmentation

Comparative analysis of machine learning frameworks for automatic polyp characterization

Bionnica: A Deep Neural Network Architecture for Colorectal Polyps' Premalignancy Risk Evaluation

CMNet: deep learning model for colon polyp segmentation based on dual-branch structure

A Boundary-Enhanced Decouple Fusion Segmentation Network for Diagnosis of Adenomatous Polyps

An automated detection system for colonoscopy images using a dual encoder-decoder model

Colorectal Cancer Detection Based on Deep Learning

Colorectal Polyp Segmentation by U-Net with Dilation Convolution

Colorectal image analysis for polyp diagnosis