Abstract:Computer-Aided Diagnosis (CAD) for polyp detection offers one of the most notable showcases. By using deep learning technologies, the accuracy of polyp segmentation is surpassing human experts. In such CAD process, a critical step is concerned with segmenting colorectal polyps from colonoscopy images. Despite remarkable successes attained by recent deep learning related works, much improvement is still anticipated to tackle challenging cases. For instance, the effects of motion blur and light reflection can introduce significant noise into the image. The same type of polyps has a diversity of size, color and texture. To address such challenges, this paper proposes a novel dual-branch multi-information aggregation network (DBMIA-Net) for polyp segmentation, which is able to accurately and reliably segment a variety of colorectal polyps with efficiency. Specifically, a dual-branch encoder with transformer and convolutional neural networks (CNN) is employed to extract polyp features, and two multi-information aggregation modules are applied in the decoder to fuse multi-scale features adaptively. Two multi-information aggregation modules include global information aggregation (GIA) module and edge information aggregation (EIA) module. In addition, to enhance the representation learning capability of the potential channel feature association, this paper also proposes a novel adaptive channel graph convolution (ACGC). To validate the effectiveness and advantages of the proposed network, we compare it with several state-of-the-art (SOTA) methods on five public datasets. Experimental results consistently demonstrate that the proposed DBMIA-Net obtains significantly superior segmentation performance across six popularly used evaluation matrices. Especially, we achieve 94.12% mean Dice on CVC-ClinicDB dataset which is 4.22% improvement compared to the previous state-of-the-art method PraNet. Compared with SOTA algorithms, DBMIA-Net has a better fitting ability and stronger generalization ability.

Data Augmentation and Improved Deformable DETR for Polyp Detection

TSO-DETR: A Network for Small Object Detection of Cervical Cells in TCT Smear

Probabilistic Modeling Ensemble Vision Transformer Improves Complex Polyp Segmentation

An Adaptive Regularization Approach to Colonoscopic Polyp Detection Using a Cascaded Structure of Encoder–Decoders

Improvement of Colon Polyp Detection Performance by Modifying the Multi-scale Network Structure and Data Augmentation

Examining the Effect of Synthetic Data Augmentation in Polyp Detection and Segmentation.

The Deep Hybrid Neural Network and an Application on Polyp Detection

DAN-PD: Domain adaptive network with parallel decoder for polyp segmentation

Real-Time Gastric Polyp Detection Using Convolutional Neural Networks

DeepCPD: deep learning with vision transformer for colorectal polyp detection

DEMF-Net: A dual encoder multi-scale feature fusion network for polyp segmentation

AugDETR: Improving Multi-scale Learning for Detection Transformer

ECC-PolypDet: Enhanced CenterNet with Contrastive Learning for Automatic Polyp Detection

Automatic Gastric Polyp Detection by Using Convolutional Neural Networks

FeDNet: Feature Decoupled Network for Polyp Segmentation from Endoscopy Images

Dual-branch multi-information aggregation network with transformer and convolution for polyp segmentation

Automatic polyp image segmentation and cancer prediction based on deep learning

Consisaug: A Consistency-based Augmentation for Polyp Detection in Endoscopy Image Analysis

Deformable DETR: Deformable Transformers for End-to-End Object Detection

A Deep Convolutional Neural Network for the Detection of Polyps in Colonoscopy Images

An Interpretable Deep Neural Network for Colorectal Polyp Diagnosis under Colonoscopy