Abstract:Recently, CNN-based and Transformer-based network have become the de-facto standard for vessel segmentation, due to their strong feature representation capabilities. However, CNNs fall short in explicitly capturing global dependencies between different spatial locations, while Transformers require quadratic computation by virtue of the long sequences and lack fine-grained local correlations. Seeking to model both local correlations and long-range dependencies, our research revisits this issue and introduces a novel retinal vessel segmentation network based on U-Net, the Coordinate and Channel Attention Mixing Flexible Architecture (C2AM-Unet), a new lightweight network that combines the U-Net model with a multi-attention mechanism. Specifically, we present a core Dual Global Coordinate Attention (DGCA) module, which embeds two types of serial global spatial-specific property information: one with a direction-aware mechanism, responsible for encoding long-range dependencies and coordinate information in both horizontal and vertical directions, and another with a transformer-like coordinate module that focuses on the connections and interactions between each spatial location. Next, the C2AM feature maps are aggregated with the direction-aware feature maps to enhance their ability to represent the objects of interest. To further strengthen the long-distance semantic dependencies, we utilize the transformer-like channel attention model to capture the cross-channel communication of global information. To verify the effectiveness of our method, we also construct other similar variant components that can be flexibly applied to other networks. The experimental results on three retinal vessel and two coronary angiography datasets, including DRIVE, STARE, CHASE_DB1, DCA1 and CHUAC, demonstrate that C2AM-Unet achieves competitive scores compared to the state-of-the-art methods.

Joint 2D attention gate and channel-spatial attention network for retinal vessel segmentation of OCT-angiography images

Accurate Retinal Vessel Segmentation via Octave Convolution Neural Network

A Multi-Scale Residual Attention Network for Retinal Vessel Segmentation

Retinal Vessel Segmentation Via Cross-attention Feature Fusion

CCS-UNet: a cross-channel spatial attention model for accurate retinal vessel segmentation

Attention-guided cascaded network with pixel-importance-balance loss for retinal vessel segmentation

A combination of multi‐scale and attention based on the U‐shaped network for retinal vessel segmentation

Attention residual convolution neural network based on U-net (AttentionResU-Net) for retina vessel segmentation

LEA U-Net: a U-Net-based deep learning framework with local feature enhancement and attention for retinal vessel segmentation

A High-Resolution Network with Strip Attention for Retinal Vessel Segmentation

EAMR-Net: A multiscale effective spatial and cross-channel attention network for retinal vessel segmentation

An improved method for retinal vessel segmentation in U-Net

Edge-aware U-net with gated convolution for retinal vessel segmentation

Attention W-Net: Improved Skip Connections for better Representations

Region Guided Attention Network for Retinal Vessel Segmentation

Attention Guided U-Net With Atrous Convolution for Accurate Retinal Vessels Segmentation

Channel Attention Residual U-Net for Retinal Vessel Segmentation

C2AM-Unet: Coordinate and Channel Attention Mixing Flexible Architecture for Retinal Vessel Segmentation

Multi-level spatial-temporal and attentional information deep fusion network for retinal vessel segmentation

A Microvascular Segmentation Network Based on Pyramidal Attention Mechanism

Lightweight Attention Convolutional Neural Network for Retinal Vessel Image Segmentation