Abstract:Purpose: Colon cancer is one of the top three diseases in gastrointestinal cancers, and colon polyps are an important trigger of colon cancer. Early diagnosis and removal of colon polyps can avoid the incidence of colon cancer. Currently, colon polyp removal surgery is mainly based on artificial-intelligence (AI) colonoscopy, supplemented by deep-learning technology to help doctors remove colon polyps. With the development of deep learning, the use of advanced AI technology to assist in medical diagnosis has become mainstream and can maximize the doctor's diagnostic time and help doctors to better formulate medical plans. Approach: We propose a deep-learning model for segmenting colon polyps. The model adopts a dual-branch structure, combines a convolutional neural network (CNN) with a transformer, and replaces ordinary convolution with deeply separable convolution based on ResNet; a stripe pooling module is introduced to obtain more effective information. The aggregated attention module (AAM) is proposed for high-dimensional semantic information, which effectively combines two different structures for the high-dimensional information fusion problem. Deep supervision and multi-scale training are added in the model training process to enhance the learning effect and generalization performance of the model. Results: The experimental results show that the proposed dual-branch structure is significantly better than the single-branch structure, and the model using the AAM has a significant performance improvement over the model not using the AAM. Our model leads 1.1% and 1.5% in mIoU and mDice, respectively, when compared with state-of-the-art models in a fivefold cross-validation on the Kvasir-SEG dataset. Conclusions: We propose and validate a deep learning model for segmenting colon polyps, using a dual-branch network structure. Our results demonstrate the feasibility of complementing traditional CNNs and transformer with each other. And we verified the feasibility of fusing different structures on high-dimensional semantics and successfully retained the high-dimensional information of different structures effectively.

Flexible Colon Polyp Detection: A Dual Mode Approach for Detection and Segmentation of Colon Polyps with Optional Inpainting for Specular Highlight Mitigation

A Deep Ensemble Learning Method for Colorectal Polyp Classification with Optimized Network Parameters

An Ensemble-Based Deep Convolutional Neural Network for Computer-Aided Polyps Identification From Colonoscopy

PolypDB: A Curated Multi-Center Dataset for Development of AI Algorithms in Colonoscopy

An Ensemble Framework of Deep Neural Networks for Colorectal Polyp Classification

Colonoscopy polyp detection and classification: Dataset creation and comparative evaluations

Assessing generalisability of deep learning-based polyp detection and segmentation methods through a computer vision challenge

An Adaptive Regularization Approach to Colonoscopic Polyp Detection Using a Cascaded Structure of Encoder–Decoders

ContourNet—An Automated Segmentation Framework for Detection of Colonic Polyps

A Deep Convolutional Neural Network for the Detection of Polyps in Colonoscopy Images

Modified DeeplabV3+ with multi-level context attention mechanism for colonoscopy polyp segmentation

Validating polyp and instrument segmentation methods in colonoscopy through Medico 2020 and MedAI 2021 Challenges

A multi-centre polyp detection and segmentation dataset for generalisability assessment

Automatic Polyp Detection in Colonoscopy Images: Convolutional Neural Network, Dataset and Transfer Learning

DeepCPD: deep learning with vision transformer for colorectal polyp detection

Towards a Computed-Aided Diagnosis System in Colonoscopy: Automatic Polyp Segmentation Using Convolution Neural Networks

An approach of polyp segmentation from colonoscopy images using Dilated-U-Net-Seg – A deep learning network

CMNet: deep learning model for colon polyp segmentation based on dual-branch structure

An efficient real-time colonic polyp detection with YOLO algorithms trained by using negative samples and large datasets

Federal learning-based a dual-branch deep learning model for colon polyp segmentation

A Real-Time Polyp-Detection System with Clinical Application in Colonoscopy Using Deep Convolutional Neural Networks