Abstract:Diabetic retinopathy (DR), retinal vein occlusion (RVO), and age-related macular degeneration (AMD) pose significant global health challenges, often resulting in vision impairment and blindness. Automatic detection of these conditions is crucial, particularly in underserved rural areas with limited access to ophthalmic services. Despite remarkable advancements in artificial intelligence, especially convolutional neural networks (CNNs), their complexity can make interpretation difficult. In this study, we curated a dataset consisting of 15,089 color fundus photographs (CFPs) obtained from 8110 patients who underwent fundus fluorescein angiography (FFA) examination. The primary objective was to construct integrated models that merge CNNs with an attention mechanism. These models were designed for a hierarchical multilabel classification task, focusing on the detection of DR, RVO, AMD, and other fundus conditions. Furthermore, our approach extended to the detailed classification of DR, RVO, and AMD according to their respective subclasses. We employed a methodology that entails the translation of diagnostic information obtained from FFA results into CFPs. Our investigation focused on evaluating the models' ability to achieve precise diagnoses solely based on CFPs. Remarkably, our models showcased improvements across diverse fundus conditions, with the ConvNeXt-base + attention model standing out for its exceptional performance. The ConvNeXt-base + attention model achieved remarkable metrics, including an area under the receiver operating characteristic curve (AUC) of 0.943, a referable F1 score of 0.870, and a Cohen's kappa of 0.778 for DR detection. For RVO, it attained an AUC of 0.960, a referable F1 score of 0.854, and a Cohen's kappa of 0.819. Furthermore, in AMD detection, the model achieved an AUC of 0.959, an F1 score of 0.727, and a Cohen's kappa of 0.686. Impressively, the model demonstrated proficiency in subclassifying RVO and AMD, showcasing commendable sensitivity and specificity. Moreover, our models enhanced interpretability by visualizing attention weights on fundus images, aiding in the identification of disease findings. These outcomes underscore the substantial impact of our models in advancing the detection of DR, RVO, and AMD, offering the potential for improved patient outcomes and positively influencing the healthcare landscape.

Explainable Diagnosis Using Deep-Learning: Classification of Fundus Images as a Promising Tool for Early Detection of Alzheimer’s Disease

Artificial intelligence as a gateway to scientific discovery: Uncovering features in retinal fundus images

Predicting sex from retinal fundus photographs using automated deep learning

Predicting Cardiovascular Risk Factors from Retinal Fundus Photographs using Deep Learning

A Novel Explainable Neural Network for Alzheimer’s Disease Diagnosis

Automatic interpretation and clinical evaluation for fundus fluorescein angiography images of diabetic retinopathy patients by deep learning

Weakly-supervised detection of AMD-related lesions in color fundus images using explainable deep learning

A deep-learning pipeline for the diagnosis and grading of common blinding ophthalmic diseases based on lesion-focused classification model

A Single Model Deep Learning Approach for Alzheimer's Disease Diagnosis

A Single Model Deep Learning Approach for Alzheimer’s Disease Diagnosis

Convolutional neural network to identify symptomatic Alzheimer’s disease using multimodal retinal imaging

An explainable two-dimensional single model deep learning approach for Alzheimer's disease diagnosis and brain atrophy localization

A multimodal deep learning system to distinguish late stages of AMD and to compare expert vs. AI ocular biomarkers

Development of a deep learning model to distinguish the cause of optic disc atrophy using retinal fundus photography

Generative artificial intelligence in ophthalmology: multimodal retinal images for the diagnosis of Alzheimer's disease with convolutional neural networks

Explainable Artificial Intelligence in Retinal Imaging for the detection of Systemic Diseases

Multi-label classification of retinal lesions in diabetic retinopathy for automatic analysis of fundus fluorescein angiography based on deep learning

Early detection of dementia through retinal imaging and trustworthy AI

Research on Assistant Diagnosis of Fundus Optic Neuropathy Based on Deep Learning.

Interpretable Detection of Diabetic Retinopathy, Retinal Vein Occlusion, Age-Related Macular Degeneration, and Other Fundus Conditions

Deep Convolution Neural Network Based System for Early Diagnosis of Alzheimer's Disease