Abstract:Purpose:The assessment of retinal image (RI) quality holds significant importance in both clinical trials and large datasets, because suboptimal images can potentially conceal early signs of diseases, thereby resulting in inaccurate medical diagnoses. This study aims to develop an automatic method for Retinal Image Quality Assessment (RIQA) that incorporates visual explanations, aiming to comprehensively evaluate the quality of retinal fundus images (RIs).Methods:We developed an automatic RIQA system, named Swin-MCSFNet, utilizing 28,792 RIs from the EyeQ dataset, as well as 2000 images from the EyePACS dataset and an additional 1,000 images from the OIA-ODIR dataset. After preprocessing, including cropping black regions, data augmentation, and normalization, a Swin-MCSFNet classifier based on the Swin-Transformer for multiple color-space fusion was proposed to grade the quality of RIs. The generalizability of Swin-MCSFNet was validated across multiple data centers. Additionally, for enhanced interpretability, a Score-CAM-generated heatmap was applied to provide visual explanations.Results:Experimental results reveal that the proposed Swin-MCSFNet achieves promising performance, yielding a micro-receiver operating characteristic (ROC) of 0.93 and ROC scores of 0.96, 0.81, and 0.96 for the "Good," "Usable," and "Reject" categories, respectively. These scores underscore the accuracy of RIQA based on Swin-MCSF in distinguishing among the three categories. Furthermore, heatmaps generated across different RIQA classification scores and various color spaces suggest that regions in the retinal images from multiple color spaces contribute significantly to the decision-making process of the Swin-MCSFNet classifier.Conclusions:Our study demonstrates that the proposed Swin-MCSFNet outperforms other methods in experiments conducted on multiple datasets, as evidenced by the superior performance metrics and insightful Score-CAM heatmaps.Translational Relevance:This study constructs a new retinal image quality evaluation system, which will contribute to the subsequent research of retinal images.

Swin-ASNet: An Adaptive RGB-selection Network with Swin Transformer for Retinal Vessel Segmentation

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

Retinal Vessel Segmentation Via Cross-attention Feature Fusion

SwinNet: Swin Transformer drives edge-aware RGB-D and RGB-T salient object detection

Enhancing Retinal Vascular Structure Segmentation in Images With a Novel Design Two-Path Interactive Fusion Module Model

HiSwin UT: Hybrid Swin Transformers Network for Segmenting 3D in Vivo Two-photon Images of Rodent Cerebrovasculature

Enhancing Retinal Fundus Image Quality Assessment with Swin-Transformer-Based Learning Across Multiple Color-Spaces

TD Swin-UNet: Texture-Driven Swin-UNet with Enhanced Boundary-Wise Perception for Retinal Vessel Segmentation

SSTrans-Net: Smart Swin Transformer Network for medical image segmentation

Swin-Net: A Swin-Transformer-Based Network Combing with Multi-Scale Features for Segmentation of Breast Tumor Ultrasound Images

SwinD-Net: a lightweight segmentation network for laparoscopic liver segmentation

Adaptive enhanced swin transformer with U-net for remote sensing image segmentation*

Swin-TransUper: Swin Transformer-based UperNet for medical image segmentation

ER-Swin: Feature Enhancement and Refinement Network Based on Swin Transformer for Semantic Segmentation of Remote Sensing Images

Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation

SURVS: A Swin-Unet and game theory-based unsupervised segmentation method for retinal vessel

FunSwin: A deep learning method to analysis diabetic retinopathy grade and macular edema risk based on fundus images

Retinal Vessel Segmentation Based on Self-Attention Feature Selection

Accurate Retinal Vessel Segmentation in Color Fundus Images Via Fully Attention-Based Networks

Swin Transformer Based Detection and Segmentation Networks for Measurement and Quantification Analysis of Arteriolar Vessels from Renal Whole Slide Images

Swin Transformer-Based Edge Guidance Network for RGB-D Salient Object Detection