Abstract:Purpose: Colon cancer is one of the top three diseases in gastrointestinal cancers, and colon polyps are an important trigger of colon cancer. Early diagnosis and removal of colon polyps can avoid the incidence of colon cancer. Currently, colon polyp removal surgery is mainly based on artificial-intelligence (AI) colonoscopy, supplemented by deep-learning technology to help doctors remove colon polyps. With the development of deep learning, the use of advanced AI technology to assist in medical diagnosis has become mainstream and can maximize the doctor's diagnostic time and help doctors to better formulate medical plans. Approach: We propose a deep-learning model for segmenting colon polyps. The model adopts a dual-branch structure, combines a convolutional neural network (CNN) with a transformer, and replaces ordinary convolution with deeply separable convolution based on ResNet; a stripe pooling module is introduced to obtain more effective information. The aggregated attention module (AAM) is proposed for high-dimensional semantic information, which effectively combines two different structures for the high-dimensional information fusion problem. Deep supervision and multi-scale training are added in the model training process to enhance the learning effect and generalization performance of the model. Results: The experimental results show that the proposed dual-branch structure is significantly better than the single-branch structure, and the model using the AAM has a significant performance improvement over the model not using the AAM. Our model leads 1.1% and 1.5% in mIoU and mDice, respectively, when compared with state-of-the-art models in a fivefold cross-validation on the Kvasir-SEG dataset. Conclusions: We propose and validate a deep learning model for segmenting colon polyps, using a dual-branch network structure. Our results demonstrate the feasibility of complementing traditional CNNs and transformer with each other. And we verified the feasibility of fusing different structures on high-dimensional semantics and successfully retained the high-dimensional information of different structures effectively.

IDDF2018-ABS-0259 Segmentation of Intestinal Polyps Via a Deep Learning Algorithm

CMNet: deep learning model for colon polyp segmentation based on dual-branch structure

A Local Region Proposals Approach to Instance Segmentation for Intestinal Polyp Detection

The Application Research of Deep Neural Networks in Colonic Polyp Segmentation

An Interpretable Deep Neural Network for Colorectal Polyp Diagnosis under Colonoscopy

Automatic polyp image segmentation and cancer prediction based on deep learning

Colorectal Polyp Segmentation Using a Fully Convolutional Neural Network

Federal learning-based a dual-branch deep learning model for colon polyp segmentation

Colorectal Polyp Segmentation by U-Net with Dilation Convolution

Automatic Polyp Segmentation in Colonoscopy Images Using a Modified Deep Convolutional Encoder-Decoder Architecture

Polyp Segmentation with Fully Convolutional Deep Neural Networks—Extended Evaluation Study

A Survey on Deep Learning for Polyp Segmentation: Techniques, Challenges and Future Trends

Towards a Computed-Aided Diagnosis System in Colonoscopy: Automatic Polyp Segmentation Using Convolution Neural Networks

An approach of polyp segmentation from colonoscopy images using Dilated-U-Net-Seg – A deep learning network

AI based colorectal disease detection using real-time screening colonoscopy

Modified DeeplabV3+ with multi-level context attention mechanism for colonoscopy polyp segmentation

ABC-Net: Area-Boundary Constraint Network With Dynamical Feature Selection for Colorectal Polyp Segmentation

Dual-branch multi-information aggregation network with transformer and convolution for polyp segmentation

Flexible Colon Polyp Detection: A Dual Mode Approach for Detection and Segmentation of Colon Polyps with Optional Inpainting for Specular Highlight Mitigation

Semantic Segmentation of Gastric Polyps in Endoscopic Images Based on Convolutional Neural Networks and an Integrated Evaluation Approach

FeDNet: Feature Decoupled Network for Polyp Segmentation from Endoscopy Images