Abstract:Computer-Aided Diagnosis (CAD) for polyp detection offers one of the most notable showcases. By using deep learning technologies, the accuracy of polyp segmentation is surpassing human experts. In such CAD process, a critical step is concerned with segmenting colorectal polyps from colonoscopy images. Despite remarkable successes attained by recent deep learning related works, much improvement is still anticipated to tackle challenging cases. For instance, the effects of motion blur and light reflection can introduce significant noise into the image. The same type of polyps has a diversity of size, color and texture. To address such challenges, this paper proposes a novel dual-branch multi-information aggregation network (DBMIA-Net) for polyp segmentation, which is able to accurately and reliably segment a variety of colorectal polyps with efficiency. Specifically, a dual-branch encoder with transformer and convolutional neural networks (CNN) is employed to extract polyp features, and two multi-information aggregation modules are applied in the decoder to fuse multi-scale features adaptively. Two multi-information aggregation modules include global information aggregation (GIA) module and edge information aggregation (EIA) module. In addition, to enhance the representation learning capability of the potential channel feature association, this paper also proposes a novel adaptive channel graph convolution (ACGC). To validate the effectiveness and advantages of the proposed network, we compare it with several state-of-the-art (SOTA) methods on five public datasets. Experimental results consistently demonstrate that the proposed DBMIA-Net obtains significantly superior segmentation performance across six popularly used evaluation matrices. Especially, we achieve 94.12% mean Dice on CVC-ClinicDB dataset which is 4.22% improvement compared to the previous state-of-the-art method PraNet. Compared with SOTA algorithms, DBMIA-Net has a better fitting ability and stronger generalization ability.

W-MAFormer: W-shaped Multi-Attention Assisted Transformer for Polyp Segmentation

Probabilistic Modeling Ensemble Vision Transformer Improves Complex Polyp Segmentation

SAEFormer: stepwise attention emphasis transformer for polyp segmentation

Multi-Layer Dense Attention Decoder for Polyp Segmentation

NA-segformer: A multi-level transformer model based on neighborhood attention for colonoscopic polyp segmentation

DHAFormer: Dual-channel hybrid attention network with transformer for polyp segmentation

Multi‐scale nested UNet with transformer for colorectal polyp segmentation

Colorectal Polyp Segmentation Based on Group Convolution and Transformer

Using Guided Self-Attention with Local Information for Polyp Segmentation

TMPSformer: An Efficient Hybrid Transformer-MLP Network for Polyp Segmentation

MAST: Video Polyp Segmentation with a Mixture-Attention Siamese Transformer

FCN-Transformer Feature Fusion for Polyp Segmentation

A lighter hybrid feature fusion framework for polyp segmentation

Multi-Dimensional Fusion Reverse Attention Network for Polyp Segmentation

Dual-branch multi-information aggregation network with transformer and convolution for polyp segmentation

SegT: A Novel Separated Edge-guidance Transformer Network for Polyp Segmentation

UMF-Net: A UNet-based Multi-Branch Feature Fusion Network for Colon Polyp Segmentation

PPFormer: A Novel Model for Polyp Segmentation in Digestive Endoscopy

Fusing Transformer and FCN for Polyp Segmentation

RTA-Former: Reverse Transformer Attention for Polyp Segmentation