Abstract:Retinal vessel segmentation plays a crucial role in the diagnosis and treatment of ocular pathologies. Current methods have limitations in feature fusion and face challenges in simultaneously capturing global and local features from fundus images. To address these issues, this study introduces a hybrid network named CoVi-Net, which combines convolutional neural networks and vision transformer. In our proposed model, we have integrated a novel module for local and global feature aggregation (LGFA). This module facilitates remote information interaction while retaining the capability to effectively gather local information. In addition, we introduce a bidirectional weighted feature fusion module (BWF). Recognizing the variations in semantic information across layers, we allocate adjustable weights to different feature layers for adaptive feature fusion. BWF employs a bidirectional fusion strategy to mitigate the decay of effective information. We also incorporate horizontal and vertical connections to enhance feature fusion and utilization across various scales, thereby improving the segmentation of multiscale vessel images. Furthermore, we introduce an adaptive lateral feature fusion (ALFF) module that refines the final vessel segmentation map by enriching it with more semantic information from the network. In the evaluation of our model, we employed three well-established retinal image databases (DRIVE, CHASEDB1, and STARE). Our experimental results demonstrate that CoVi-Net outperforms other state-of-the-art techniques, achieving a global accuracy of 0.9698, 0.9756, and 0.9761 and an area under the curve of 0.9880, 0.9903, and 0.9915 on DRIVE, CHASEDB1, and STARE, respectively. We conducted ablation studies to assess the individual effectiveness of the three modules. In addition, we examined the adaptability of our CoVi-Net model for segmenting lesion images. Our experiments indicate that our proposed model holds promise in aiding the diagnosis of retinal vascular disorders.

Enhancing Retinal Vascular Structure Segmentation in Images With a Novel Design Two-Path Interactive Fusion Module Model

Accurate Retinal Vessel Segmentation via Octave Convolution Neural Network

Retinal Vessel Segmentation Via Cross-attention Feature Fusion

Multi-resolution Fusion Input U-shaped Retinal Vessel Segmentation Algorithm

Retinal vessel image segmentation algorithm based on encoder-decoder structure

CMP-UNet: A Retinal Vessel Segmentation Network Based on Multi-Scale Feature Fusion

A multi-scale feature extraction and fusion-based model for retinal vessel segmentation in fundus images

Retinal Blood Vessels Segmentation With Improved SE‐UNet Model

SegR-Net: A deep learning framework with multi-scale feature fusion for robust retinal vessel segmentation

Swin-ASNet: An Adaptive RGB-selection Network with Swin Transformer for Retinal Vessel Segmentation

Retinal Vascular Image Segmentation Using Improved UNet Based on Residual Module

TD Swin-UNet: Texture-Driven Swin-UNet with Enhanced Boundary-Wise Perception for Retinal Vessel Segmentation

U-shaped Retinal Vessel Segmentation Based on Adaptive Aggregation of Feature Information

Research on Retinal Vessel Segmentation Algorithm Based on a Modified U-Shaped Network

Exploiting Cross-Scale Attention Transformer and Progressive Edge Refinement for Retinal Vessel Segmentation

Optimizing Medical Image Segmentation with Advanced Decoder Design

DCFU‐Net: Rethinking an Effective Attention and Convolutional Architecture for Retinal Vessel Segmentation

HRD-net: High resolution segmentation network with adaptive learning ability of retinal vessel features

Skip connection information enhancement network for retinal vessel segmentation

CoVi-Net: A hybrid convolutional and vision transformer neural network for retinal vessel segmentation

Retinal Vessel Segmentation Based on Self-Attention Feature Selection