Abstract:Background Polyp detection and localization are essential tasks for colonoscopy. U‐shape network based convolutional neural networks have achieved remarkable segmentation performance for biomedical images, but lack of long‐range dependencies modeling limits their receptive fields. Purpose Our goal was to develop and test a novel architecture for polyp segmentation, which takes advantage of learning local information with long‐range dependencies modeling. Methods A novel architecture combining with multi‐scale nested UNet structure integrated transformer for polyp segmentation was developed. The proposed network takes advantage of both CNN and transformer to extract distinct feature information. The transformer layer is embedded between the encoder and decoder of a U‐shape net to learn explicit global context and long‐range semantic information. To address the challenging of variant polyp sizes, a MSFF unit was proposed to fuse features with multiple resolution. Results Four public datasets and one in‐house dataset were used to train and test the model performance. Ablation study was also conducted to verify each component of the model. For dataset Kvasir‐SEG and CVC‐ClinicDB, the proposed model achieved mean dice score of 0.942 and 0.950 respectively, which were more accurate than the other methods. To show the generalization of different methods, we processed two cross dataset validations, the proposed model achieved the highest mean dice score. The results demonstrate that the proposed network has powerful learning and generalization capability, significantly improving segmentation accuracy and outperforming state‐of‐the‐art methods. Conclusions The proposed model produced more accurate polyp segmentation than current methods on four different public and one in‐house datasets. Its capability of polyps segmentation in different sizes shows the potential clinical application

TranSEFusionNet: Deep fusion network for colorectal polyp segmentation

Cooperation Learning Enhanced Colonic Polyp Segmentation Based on Transformer-CNN Fusion

DEMF-Net: A dual encoder multi-scale feature fusion network for polyp segmentation

LightCF-Net: A Lightweight Long-Range Context Fusion Network for Real-Time Polyp Segmentation

Probabilistic Modeling Ensemble Vision Transformer Improves Complex Polyp Segmentation

FCN-Transformer Feature Fusion for Polyp Segmentation

Polyp Segmentation Network with Hybrid Channel-Spatial Attention and Pyramid Global Context Guided Feature Fusion

CoAM-Net: Coordinate Asymmetric Multi-Scale Fusion Strategy for Polyp Segmentation

FLDNet: A Foreground-Aware Network for Polyp Segmentation Leveraging Long-Distance Dependencies

Cross-Level Context Fusion Network for Polyp Segmentation in Colonoscopy Images

BFE-Net: Bilateral Fusion Enhanced Network for Gastrointestinal Polyp Segmentation

PolySegNet: improving polyp segmentation through swin transformer and vision transformer fusion

SAEFormer: stepwise attention emphasis transformer for polyp segmentation

HIGF-Net: Hierarchical Information-Guided Fusion Network for Polyp Segmentation Based on Transformer and Convolution Feature Learning

FTMF-Net: A Fourier Transform-Multiscale Feature Fusion Network for Segmentation of Small Polyp Objects.

ECTransNet: An Automatic Polyp Segmentation Network Based on Multi-scale Edge Complementary

Enhanced U-Net: A Feature Enhancement Network for Polyp Segmentation

Multi‐scale nested UNet with transformer for colorectal polyp segmentation

Polyp Segmentation With the FCB-SwinV2 Transformer

Improving Polyp Segmentation with Boundary-Assisted Guidance and Cross-Scale Interaction Fusion Transformer Network

Colorectal Polyp Segmentation Based on Group Convolution and Transformer