Abstract:Purpose: Colon cancer is one of the top three diseases in gastrointestinal cancers, and colon polyps are an important trigger of colon cancer. Early diagnosis and removal of colon polyps can avoid the incidence of colon cancer. Currently, colon polyp removal surgery is mainly based on artificial-intelligence (AI) colonoscopy, supplemented by deep-learning technology to help doctors remove colon polyps. With the development of deep learning, the use of advanced AI technology to assist in medical diagnosis has become mainstream and can maximize the doctor's diagnostic time and help doctors to better formulate medical plans. Approach: We propose a deep-learning model for segmenting colon polyps. The model adopts a dual-branch structure, combines a convolutional neural network (CNN) with a transformer, and replaces ordinary convolution with deeply separable convolution based on ResNet; a stripe pooling module is introduced to obtain more effective information. The aggregated attention module (AAM) is proposed for high-dimensional semantic information, which effectively combines two different structures for the high-dimensional information fusion problem. Deep supervision and multi-scale training are added in the model training process to enhance the learning effect and generalization performance of the model. Results: The experimental results show that the proposed dual-branch structure is significantly better than the single-branch structure, and the model using the AAM has a significant performance improvement over the model not using the AAM. Our model leads 1.1% and 1.5% in mIoU and mDice, respectively, when compared with state-of-the-art models in a fivefold cross-validation on the Kvasir-SEG dataset. Conclusions: We propose and validate a deep learning model for segmenting colon polyps, using a dual-branch network structure. Our results demonstrate the feasibility of complementing traditional CNNs and transformer with each other. And we verified the feasibility of fusing different structures on high-dimensional semantics and successfully retained the high-dimensional information of different structures effectively.

Shared Hybrid Attention Transformer Network for Colon Polyp Segmentation

DHAFormer: Dual-channel hybrid attention network with transformer for polyp segmentation

A lighter hybrid feature fusion framework for polyp segmentation

Progressive Group Convolution Fusion Network for Colon Polyp Segmentation

Colorectal Polyp Segmentation Based on Group Convolution and Transformer

Probabilistic Modeling Ensemble Vision Transformer Improves Complex Polyp Segmentation

SAEFormer: stepwise attention emphasis transformer for polyp segmentation

CMNet: deep learning model for colon polyp segmentation based on dual-branch structure

W-MAFormer: W-shaped Multi-Attention Assisted Transformer for Polyp Segmentation

NA-segformer: A multi-level transformer model based on neighborhood attention for colonoscopic polyp segmentation

CTNet: Contrastive Transformer Network for Polyp Segmentation

SegT: A Novel Separated Edge-guidance Transformer Network for Polyp Segmentation

Multi‐scale nested UNet with transformer for colorectal polyp segmentation

Cooperation Learning Enhanced Colonic Polyp Segmentation Based on Transformer-CNN Fusion

Simultaneous segmentation and classification of colon cancer polyp images using a dual branch multi-task learning network

Polyp Segmentation With the FCB-SwinV2 Transformer

Using Guided Self-Attention with Local Information for Polyp Segmentation

Multi-scale Information Sharing and Selection Network with Boundary Attention for Polyp Segmentation

Self-Adaptive Teacher-Student framework for colon polyp segmentation from unannotated private data with public annotated datasets

RetSeg: Retention-based Colorectal Polyps Segmentation Network