Abstract:Automatic retinal vessel segmentation is important for the diagnosis and prevention of ophthalmic diseases. The existing deep learning retinal vessel segmentation models always treat each pixel equally. However, the multi-scale vessel structure is a vital factor affecting the segmentation results, especially in thin vessels. To address this crucial gap, we propose a novel Fully Attention-based Network (FANet) based on attention mechanisms to adaptively learn rich feature representation and aggregate the multi-scale information. Specifically, the framework consists of the image pre-processing procedure and the semantic segmentation networks. Green channel extraction (GE) and contrast limited adaptive histogram equalization (CLAHE) are employed as pre-processing to enhance the texture and contrast of retinal blood images. Besides, the network combines two types of attention modules with the U-Net. We propose a lightweight dual-direction attention block to model global dependencies and reduce intra-class inconsistencies, in which the weights of feature maps are updated based on the semantic correlation between pixels. The dual-direction attention block utilizes horizontal and vertical pooling operations to produce the attention map. In this way, the network aggregates global contextual information from semantic-closer regions or a series of pixels belonging to the same object category. Meanwhile, we adopt the selective kernel (SK) unit to replace the standard convolution for obtaining multi-scale features of different receptive field sizes generated by soft attention. Furthermore, we demonstrate that the proposed model can effectively identify irregular, noisy, and multi-scale retinal vessels. The abundant experiments on DRIVE, STARE, and CHASE_DB1 datasets show that our method achieves state-of-the-art performance.

A multi-scale feature extraction and fusion-based model for retinal vessel segmentation in fundus images

Retinal Vessel Segmentation Via Cross-attention Feature Fusion

A Multi-Scale Residual Attention Network for Retinal Vessel Segmentation

A Multi-Scale Feature Fusion Method Based on U-Net for Retinal Vessel Segmentation

Multi-resolution Fusion Input U-shaped Retinal Vessel Segmentation Algorithm

A Multi-Scale Attention Fusion Network for Retinal Vessel Segmentation

Multi-Scale Residual U-Net Fundus Blood Vessel Segmentation Based on Attention Mechanism

An improved method for retinal vessel segmentation in U-Net

Multi-Scale Retinal Vessel Segmentation Based on Fully Convolutional Neural Network

A retinal vessel segmentation network with multiple-dimension attention and adaptive feature fusion

Attention-inception-based U-Net for Retinal Vessel Segmentation with Advanced Residual

Multichannel Retinal Blood Vessel Segmentation Based on the Combination of Matched Filter and U-Net Network.

CMP-UNet: A Retinal Vessel Segmentation Network Based on Multi-Scale Feature Fusion

AMF-NET: Attention-aware Multi-scale Fusion Network for Retinal Vessel Segmentation

Vessel Segmentation in Fundus Images with Multi-Scale Feature Extraction and Disentangled Representation

MAFE-Net: retinal vessel segmentation based on a multiple attention-guided fusion mechanism and ensemble learning network

A High-Resolution Network with Strip Attention for Retinal Vessel Segmentation

IMFF-Net: An integrated multi-scale feature fusion network for accurate retinal vessel segmentation from fundus images

Accurate Retinal Vessel Segmentation in Color Fundus Images Via Fully Attention-Based Networks

LEA U-Net: a U-Net-based deep learning framework with local feature enhancement and attention for retinal vessel segmentation

A combination of multi‐scale and attention based on the U‐shaped network for retinal vessel segmentation