Abstract:Accurate and automatic segmentation of medical images is a key step in clinical diagnosis and analysis. Currently, the successful application of Transformers' model in the field of computer vision, researchers have begun to gradually explore the application of Transformers in medical segmentation of images, especially in combination with convolutional neural networks with coding-decoding structure, which have achieved remarkable results in the field of medical segmentation. However, most studies have combined Transformers with CNNs at a single scale or processed only the highest-level semantic feature information, ignoring the rich location information in the lower-level semantic feature information. At the same time, for problems such as blurred structural boundaries and heterogeneous textures in images, most existing methods usually simply connect contour information to capture the boundaries of the target. However, these methods cannot capture the precise outline of the target and ignore the potential relationship between the boundary and the region. In this paper, we propose the TGDAUNet, which consists of a dual-branch backbone network of CNNs and Transformers and a parallel attention mechanism, to achieve accurate segmentation of lesions in medical images. Firstly, high-level semantic feature information of the CNN backbone branches is fused at multiple scales, and the high-level and low-level feature information complement each other's location and spatial information. We further use the polarised self-attentive (PSA) module to reduce the impact of redundant information caused by multiple scales, to better couple with the feature information extracted from the Transformers backbone branch, and to establish global contextual long-range dependencies at multiple scales. In addition, we have designed the Reverse Graph-reasoned Fusion (RGF) module and the Feature Aggregation (FA) module to jointly guide the global context. The FA module aggregates high-level semantic feature information to generate an original global predictive segmentation map. The RGF module captures non-significant features of the boundaries in the original or secondary global prediction segmentation graph through a reverse attention mechanism, establishing a graph reasoning module to explore the potential semantic relationships between boundaries and regions, further refining the target boundaries. Finally, to validate the effectiveness of our proposed method, we compare our proposed method with the current popular methods in the CVC-ClinicDB, Kvasir-SEG, ETIS, CVC-ColonDB, CVC-300,datasets as well as the skin cancer segmentation datasets ISIC-2016 and ISIC-2017. The large number of experimental results show that our method outperforms the currently popular methods. Source code is released at https://github.com/sd-spf/TGDAUNet.

Integrating Dual Attention with TransUNet for Esophagus Image Segmentation

Esophageal Image Segmentation with Dual Attention Based on TransUNet

DA-TransUNet: Integrating Spatial and Channel Dual Attention with Transformer U-Net for Medical Image Segmentation

Esophageal Tumor Segmentation in CT Images using Dilated Dense Attention Unet (DDAUnet)

EG-TransUNet: a transformer-based U-Net with enhanced and guided models for biomedical image segmentation

A dual-branch and dual attention transformer and CNN hybrid network for ultrasound image segmentation

TransAttUnet: Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation.

TGDAUNet: Transformer and GCNN based dual-branch attention UNet for medical image segmentation

Medical Image Segmentation Using Dual Branch Networks with Embedded Attention Mechanism.

Enhanced Transformer Encoder and Hybrid Cascaded Upsampler for Medical Image Segmentation.

Dual-attention transformer-based hybrid network for multi-modal medical image segmentation

Dual Channel-Spatial Self-Attention Transformer and CNN Synergy Network for 3D Medical Image Segmentation

Segmentation Prompts Classification: A Nnunet-Based 3D Transfer Learning Framework with ROI Tokenization and Cross-Task Attention for Esophageal Cancer T-stage Diagnosis

UNet based on dynamic convolution decomposition and triplet attention

AD-DUNet: A dual-branch encoder approach by combining axial Transformer with cascaded dilated convolutions for liver and hepatic tumor segmentation

U-Net Plus: Deep Semantic Segmentation for Esophagus and Esophageal Cancer in Computed Tomography Images

Eso-Net: A Novel 2.5D Segmentation Network with the Multi-Structure Response Filter for the Cancerous Esophagus

DFA-UNet: dual-stream feature-fusion attention U-Net for lymph node segmentation in lung cancer diagnosis

DAN-NucNet: A Dual Attention Based Framework for Nuclei Segmentation in Cancer Histology Images under Wild Clinical Conditions

H2MaT-Unet:Hierarchical hybrid multi-axis transformer based Unet for medical image segmentation

Multiresolution Aggregation Transformer UNet Based on Multiscale Input and Coordinate Attention for Medical Image Segmentation