Abstract:Background: Retinal and optic disc images are used to assess changes in the retinal vasculature. These can be changes associated with diseases such as diabetic retinopathy and glaucoma or induced using ophthalmodynamometry to measure arterial and venous pressure. Key steps toward automating the assessment of these changes are the segmentation and classification of the veins and arteries. However, such segmentation and classification are still required to be manually labelled by experts. Such automated labelling is challenging because of the complex morphology, anatomical variations, alterations due to disease and scarcity of labelled data for algorithm development. We present a deep machine learning solution called the multiscale guided attention network for retinal artery and vein segmentation and classification (MSGANet-RAV). Methods: MSGANet-RAV was developed and tested on 383 colour clinical optic disc images from LEI-CENTRAL, constructed in-house and 40 colour fundus images from the AV-DRIVE public dataset. The datasets have a mean optic disc occupancy per image of 60.6% and 2.18%, respectively. MSGANet-RAV is a U-shaped encoder-decoder network, where the encoder extracts multiscale features, and the decoder includes a sequence of self-attention modules. The self-attention modules explore, guide and incorporate vessel-specific structural and contextual feature information to segment and classify central optic disc and retinal vessel pixels. Results: MSGANet-RAV achieved a pixel classification accuracy of 93.15%, sensitivity of 92.19%, and specificity of 94.13% on LEI-CENTRAL, outperforming several reference models. It similarly performed highly on AV-DRIVE with an accuracy, sensitivity and specificity of 95.48%, 93.59% and 97.27%, respectively. Conclusion: The results show the efficacy of MSGANet-RAV for identifying central optic disc and retinal arteries and veins. The method can be used in automated systems designed to assess vascular changes in retinal and optic disc images quantitatively.

MGA-Net: Multiscale Global Feature Aggregation Network for Arteriovenous Classification

A Multi-Scale Residual Attention Network for Retinal Vessel Segmentation

Multi-scale Interactive Network with Artery/Vein Discriminator for Retinal Vessel Classification

AVNet: A retinal artery/vein classification network with category-attention weighted fusion

Skeleton-guided multi-scale dual-coordinate attention aggregation network for retinal blood vessel segmentation

LMSA‐Net: A lightweight multi‐scale aware network for retinal vessel segmentation

MSGANet-RAV: A multiscale guided attention network for artery-vein segmentation and classification from optic disc and retinal images

Dual-path multi-scale context dense aggregation network for retinal vessel segmentation

MAFE-Net: retinal vessel segmentation based on a multiple attention-guided fusion mechanism and ensemble learning network

Attention-guided cascaded network with pixel-importance-balance loss for retinal vessel segmentation

CFFANet: category feature fusion and attention mechanism network for retinal vessel segmentation

A combination of multi‐scale and attention based on the U‐shaped network for retinal vessel segmentation

A retinal vessel segmentation network with multiple-dimension attention and adaptive feature fusion

Automated segmentaiton and classification of arterioles and venules using Cascading Dilated Convolutional Neural Networks

MAF-Net: Multiple attention-guided fusion network for fundus vascular image segmentation

U-shaped Retinal Vessel Segmentation Based on Adaptive Aggregation of Feature Information

SCINet: A Segmentation and Classification Interaction CNN Method for Arteriosclerotic Retinopathy Grading

Cascaded Attention Guided Network for Retinal Vessel Segmentation.

A feature aggregation and feature fusion network for retinal vessel segmentation

Efficient retinal artery/vein classification with dense color-invariant feature learning

Multi-Task Neural Networks with Spatial Activation for Retinal Vessel Segmentation and Artery/Vein Classification