Abstract:Diabetic retinopathy (DR), retinal vein occlusion (RVO), and age-related macular degeneration (AMD) pose significant global health challenges, often resulting in vision impairment and blindness. Automatic detection of these conditions is crucial, particularly in underserved rural areas with limited access to ophthalmic services. Despite remarkable advancements in artificial intelligence, especially convolutional neural networks (CNNs), their complexity can make interpretation difficult. In this study, we curated a dataset consisting of 15,089 color fundus photographs (CFPs) obtained from 8110 patients who underwent fundus fluorescein angiography (FFA) examination. The primary objective was to construct integrated models that merge CNNs with an attention mechanism. These models were designed for a hierarchical multilabel classification task, focusing on the detection of DR, RVO, AMD, and other fundus conditions. Furthermore, our approach extended to the detailed classification of DR, RVO, and AMD according to their respective subclasses. We employed a methodology that entails the translation of diagnostic information obtained from FFA results into CFPs. Our investigation focused on evaluating the models' ability to achieve precise diagnoses solely based on CFPs. Remarkably, our models showcased improvements across diverse fundus conditions, with the ConvNeXt-base + attention model standing out for its exceptional performance. The ConvNeXt-base + attention model achieved remarkable metrics, including an area under the receiver operating characteristic curve (AUC) of 0.943, a referable F1 score of 0.870, and a Cohen's kappa of 0.778 for DR detection. For RVO, it attained an AUC of 0.960, a referable F1 score of 0.854, and a Cohen's kappa of 0.819. Furthermore, in AMD detection, the model achieved an AUC of 0.959, an F1 score of 0.727, and a Cohen's kappa of 0.686. Impressively, the model demonstrated proficiency in subclassifying RVO and AMD, showcasing commendable sensitivity and specificity. Moreover, our models enhanced interpretability by visualizing attention weights on fundus images, aiding in the identification of disease findings. These outcomes underscore the substantial impact of our models in advancing the detection of DR, RVO, and AMD, offering the potential for improved patient outcomes and positively influencing the healthcare landscape.

Multi-classification of fundus diseases based on DSRA-CNN

A multi-class fundus disease classification system based on an adaptive scale discriminator and hybrid loss

Combining convolutional neural networks and self-attention for fundus diseases identification

Deep Learning for the Detection of Multiple Fundus Diseases Using Ultra-widefield Images

Multi-Label Fundus Image Classification Using Attention Mechanisms and Feature Fusion

Multi-label classification of retinal diseases based on fundus images using Resnet and Transformer

A deep learning framework for the early detection of multi-retinal diseases

Comparative Study of Transfer Learning Models for Retinal Disease Diagnosis from Fundus Images

Interpretable Detection of Diabetic Retinopathy, Retinal Vein Occlusion, Age-Related Macular Degeneration, and Other Fundus Conditions

Fundus Image Generation and Classification of Diabetic Retinopathy Based on Convolutional Neural Network

Multi-label classification of retinal lesions in diabetic retinopathy for automatic analysis of fundus fluorescein angiography based on deep learning

Multi-classification of eye disease based on fundus images using hybrid Squeeze Net and LRCN model

Prediction of Different Eye Diseases Based on Fundus Photography via Deep Transfer Learning

Automated fundus ultrasound image classification based on siamese convolutional neural networks with multi-attention

Diagnosis of Multiple Fundus Disorders Amidst a Scarcity of Medical Experts Via Self-supervised Machine Learning

Multi-label classification of fundus images with graph convolutional network and LightGBM

Fundus image classification using Inception V3 and ResNet-50 for the early diagnostics of fundus diseases

Multi-step framework for glaucoma diagnosis in retinal fundus images using deep learning

Adaptive Multiscale Retinal Diagnosis: A Hybrid Trio-Model Approach for Comprehensive Fundus Multi-Disease Detection Leveraging Transfer Learning and Siamese Networks

A Health Diagnosis System based on Transfer Learning and Multi-scale Dilated Convolution from Binocular Fundus Image Pairs

A Benchmark of Ocular Disease Intelligent Recognition: One Shot for Multi-disease Detection