Abstract:Diabetic retinopathy (DR), retinal vein occlusion (RVO), and age-related macular degeneration (AMD) pose significant global health challenges, often resulting in vision impairment and blindness. Automatic detection of these conditions is crucial, particularly in underserved rural areas with limited access to ophthalmic services. Despite remarkable advancements in artificial intelligence, especially convolutional neural networks (CNNs), their complexity can make interpretation difficult. In this study, we curated a dataset consisting of 15,089 color fundus photographs (CFPs) obtained from 8110 patients who underwent fundus fluorescein angiography (FFA) examination. The primary objective was to construct integrated models that merge CNNs with an attention mechanism. These models were designed for a hierarchical multilabel classification task, focusing on the detection of DR, RVO, AMD, and other fundus conditions. Furthermore, our approach extended to the detailed classification of DR, RVO, and AMD according to their respective subclasses. We employed a methodology that entails the translation of diagnostic information obtained from FFA results into CFPs. Our investigation focused on evaluating the models' ability to achieve precise diagnoses solely based on CFPs. Remarkably, our models showcased improvements across diverse fundus conditions, with the ConvNeXt-base + attention model standing out for its exceptional performance. The ConvNeXt-base + attention model achieved remarkable metrics, including an area under the receiver operating characteristic curve (AUC) of 0.943, a referable F1 score of 0.870, and a Cohen's kappa of 0.778 for DR detection. For RVO, it attained an AUC of 0.960, a referable F1 score of 0.854, and a Cohen's kappa of 0.819. Furthermore, in AMD detection, the model achieved an AUC of 0.959, an F1 score of 0.727, and a Cohen's kappa of 0.686. Impressively, the model demonstrated proficiency in subclassifying RVO and AMD, showcasing commendable sensitivity and specificity. Moreover, our models enhanced interpretability by visualizing attention weights on fundus images, aiding in the identification of disease findings. These outcomes underscore the substantial impact of our models in advancing the detection of DR, RVO, and AMD, offering the potential for improved patient outcomes and positively influencing the healthcare landscape.

Retinal Microaneurysm Detection Using Clinical Report Guided Multi-sieving CNN.

Automatic Analysis of Microaneurysms Turnover to Diagnose the Progression of Diabetic Retinopathy.

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

Effects of Two Types of Neuromuscular Electrical Stimulation Training on Vertical Jump Performance

An Automatic Detection Model of Microaneurysms Based on Improved FC-Densenet

SAFP-Net: A spatially augmented feature pyramid network for automatic detection of microaneurysms

Feature-transfer network and local background suppression for microaneurysm detection

Retinal Microaneurysms Detection using Local Convergence Index Features

Microaneurysms Detection in Retinal Fundus Images Based on Shape Constraint with Region-Context Features

Automated Detection of Microaneurysms in Color Fundus Images using Deep Learning with Different Preprocessing Approaches

A new detection model of microaneurysms based on improved FC-DenseNet

APNet: Adaptive Patch-based Network for Microaneurysm Detection in Fundus Images

Quantitation of polymorphonuclear leukocyte adherence to endothelial cells by electronic particle size discrimination.

New hierarchical approach for microaneurysms detection with matched filter and machine learning

Multi-resolution visual Mamba with multi-directional selective mechanism for retinal disease detection

A deep learning framework for the early detection of multi-retinal diseases

Sphingosine 1-phosphate induces antimicrobial activity both in vitro and in vivo.

Advances in retinal microaneurysms detection, segmentation and datasets for the diagnosis of diabetic retinopathy: a systematic literature review

Interpretable Detection of Diabetic Retinopathy, Retinal Vein Occlusion, Age-Related Macular Degeneration, and Other Fundus Conditions

A Novel Artificial-Intelligence-Based Approach for Automatic Assessment of Retinal Disease Images Using Multi-View Deep-Broad Learning Network

Multi-label classification of retinal lesions in diabetic retinopathy for automatic analysis of fundus fluorescein angiography based on deep learning