Abstract:Diabetic retinopathy (DR), retinal vein occlusion (RVO), and age-related macular degeneration (AMD) pose significant global health challenges, often resulting in vision impairment and blindness. Automatic detection of these conditions is crucial, particularly in underserved rural areas with limited access to ophthalmic services. Despite remarkable advancements in artificial intelligence, especially convolutional neural networks (CNNs), their complexity can make interpretation difficult. In this study, we curated a dataset consisting of 15,089 color fundus photographs (CFPs) obtained from 8110 patients who underwent fundus fluorescein angiography (FFA) examination. The primary objective was to construct integrated models that merge CNNs with an attention mechanism. These models were designed for a hierarchical multilabel classification task, focusing on the detection of DR, RVO, AMD, and other fundus conditions. Furthermore, our approach extended to the detailed classification of DR, RVO, and AMD according to their respective subclasses. We employed a methodology that entails the translation of diagnostic information obtained from FFA results into CFPs. Our investigation focused on evaluating the models' ability to achieve precise diagnoses solely based on CFPs. Remarkably, our models showcased improvements across diverse fundus conditions, with the ConvNeXt-base + attention model standing out for its exceptional performance. The ConvNeXt-base + attention model achieved remarkable metrics, including an area under the receiver operating characteristic curve (AUC) of 0.943, a referable F1 score of 0.870, and a Cohen's kappa of 0.778 for DR detection. For RVO, it attained an AUC of 0.960, a referable F1 score of 0.854, and a Cohen's kappa of 0.819. Furthermore, in AMD detection, the model achieved an AUC of 0.959, an F1 score of 0.727, and a Cohen's kappa of 0.686. Impressively, the model demonstrated proficiency in subclassifying RVO and AMD, showcasing commendable sensitivity and specificity. Moreover, our models enhanced interpretability by visualizing attention weights on fundus images, aiding in the identification of disease findings. These outcomes underscore the substantial impact of our models in advancing the detection of DR, RVO, and AMD, offering the potential for improved patient outcomes and positively influencing the healthcare landscape.

Computationally Efficient Optic Nerve Head Detection in Retinal Fundus Images

Automated Fovea Detection Based on Unsupervised Retinal Vessel Segmentation Method

Computer-aided Diagnosis Based on Enhancement of Degraded Fundus Photographs.

Detection of optic disc in human retinal images utilizing the Bitterling Fish Optimization (BFO) algorithm

A Novel Hybrid Optic Disc Detection and Fovea Localization Method Integrating Region-Based Convnet and Mathematical Approach

Automatic and efficient detection of the fovea center in retinal images

Multi-label deep learning for comprehensive optic nerve head segmentation through data of fundus images

Optic-Net: A Novel Convolutional Neural Network for Diagnosis of Retinal Diseases from Optical Tomography Images

Optimized Improved Random Forest-Fostered Glaucoma Detection from Fundus Retinal Images

Finding New Diagnostic Information for Detecting Glaucoma using Neural Networks

A complementary method for automated detection of microaneurysms in fluorescein angiography fundus images to assess diabetic retinopathy

Deep learning segmentation of non-perfusion area from color fundus images and AI-generated fluorescein angiography

Assessing spectral effectiveness in color fundus photography for deep learning classification of retinopathy of prematurity

A Fast and Effective Method of Macula Automatic Detection for Retina Images

Computer Aided Diagnosis and Out-of-Distribution Detection in Glaucoma Screening Using Color Fundus Photography

Assisting Glaucoma Screening Process Using Feature Excitation and Information Aggregation Techniques in Retinal Fundus Images

GARDNet: Robust Multi-View Network for Glaucoma Classification in Color Fundus Images

Optic disc segmentation for glaucoma screening system using fundus images

Brighteye: Glaucoma Screening with Color Fundus Photographs based on Vision Transformer

Automated Detection of Microaneurysms in Color Fundus Images using Deep Learning with Different Preprocessing Approaches

Interpretable Detection of Diabetic Retinopathy, Retinal Vein Occlusion, Age-Related Macular Degeneration, and Other Fundus Conditions