Abstract:Purpose: Colon cancer is one of the top three diseases in gastrointestinal cancers, and colon polyps are an important trigger of colon cancer. Early diagnosis and removal of colon polyps can avoid the incidence of colon cancer. Currently, colon polyp removal surgery is mainly based on artificial-intelligence (AI) colonoscopy, supplemented by deep-learning technology to help doctors remove colon polyps. With the development of deep learning, the use of advanced AI technology to assist in medical diagnosis has become mainstream and can maximize the doctor's diagnostic time and help doctors to better formulate medical plans. Approach: We propose a deep-learning model for segmenting colon polyps. The model adopts a dual-branch structure, combines a convolutional neural network (CNN) with a transformer, and replaces ordinary convolution with deeply separable convolution based on ResNet; a stripe pooling module is introduced to obtain more effective information. The aggregated attention module (AAM) is proposed for high-dimensional semantic information, which effectively combines two different structures for the high-dimensional information fusion problem. Deep supervision and multi-scale training are added in the model training process to enhance the learning effect and generalization performance of the model. Results: The experimental results show that the proposed dual-branch structure is significantly better than the single-branch structure, and the model using the AAM has a significant performance improvement over the model not using the AAM. Our model leads 1.1% and 1.5% in mIoU and mDice, respectively, when compared with state-of-the-art models in a fivefold cross-validation on the Kvasir-SEG dataset. Conclusions: We propose and validate a deep learning model for segmenting colon polyps, using a dual-branch network structure. Our results demonstrate the feasibility of complementing traditional CNNs and transformer with each other. And we verified the feasibility of fusing different structures on high-dimensional semantics and successfully retained the high-dimensional information of different structures effectively.

Dual ensemble system for polyp segmentation with submodels adaptive selection ensemble

A Deep Ensemble Learning Method for Colorectal Polyp Classification with Optimized Network Parameters

Probabilistic Modeling Ensemble Vision Transformer Improves Complex Polyp Segmentation

CMNet: deep learning model for colon polyp segmentation based on dual-branch structure

An Adaptive Regularization Approach to Colonoscopic Polyp Detection Using a Cascaded Structure of Encoder–Decoders

Ensemble Learning based on Classifier Prediction Confidence and Comprehensive Learning Particle Swarm Optimisation for polyp localisation

An Ensemble Framework of Deep Neural Networks for Colorectal Polyp Classification

An Ensemble-Based Deep Convolutional Neural Network for Computer-Aided Polyps Identification From Colonoscopy

DBE-Net: Dual Boundary-Guided Attention Exploration Network for Polyp Segmentation

Ensembles of Convolutional Neural Networks and Transformers for Polyp Segmentation

Federal learning-based a dual-branch deep learning model for colon polyp segmentation

Enhanced segmentation of gastrointestinal polyps from capsule endoscopy images with artifacts using ensemble learning

Simultaneous segmentation and classification of colon cancer polyp images using a dual branch multi-task learning network

Dual encoder–decoder-based deep polyp segmentation network for colonoscopy images

Ensemble architecture in polyp segmentation

Adaptive Context Selection for Polyp Segmentation

Dataset-level Color Augmentation and Multi-scale Exploration Methods for Polyp Segmentation

Multi-scale Information Sharing and Selection Network with Boundary Attention for Polyp Segmentation

Dual-branch multi-information aggregation network with transformer and convolution for polyp segmentation