Abstract:Diabetic retinopathy (DR), retinal vein occlusion (RVO), and age-related macular degeneration (AMD) pose significant global health challenges, often resulting in vision impairment and blindness. Automatic detection of these conditions is crucial, particularly in underserved rural areas with limited access to ophthalmic services. Despite remarkable advancements in artificial intelligence, especially convolutional neural networks (CNNs), their complexity can make interpretation difficult. In this study, we curated a dataset consisting of 15,089 color fundus photographs (CFPs) obtained from 8110 patients who underwent fundus fluorescein angiography (FFA) examination. The primary objective was to construct integrated models that merge CNNs with an attention mechanism. These models were designed for a hierarchical multilabel classification task, focusing on the detection of DR, RVO, AMD, and other fundus conditions. Furthermore, our approach extended to the detailed classification of DR, RVO, and AMD according to their respective subclasses. We employed a methodology that entails the translation of diagnostic information obtained from FFA results into CFPs. Our investigation focused on evaluating the models' ability to achieve precise diagnoses solely based on CFPs. Remarkably, our models showcased improvements across diverse fundus conditions, with the ConvNeXt-base + attention model standing out for its exceptional performance. The ConvNeXt-base + attention model achieved remarkable metrics, including an area under the receiver operating characteristic curve (AUC) of 0.943, a referable F1 score of 0.870, and a Cohen's kappa of 0.778 for DR detection. For RVO, it attained an AUC of 0.960, a referable F1 score of 0.854, and a Cohen's kappa of 0.819. Furthermore, in AMD detection, the model achieved an AUC of 0.959, an F1 score of 0.727, and a Cohen's kappa of 0.686. Impressively, the model demonstrated proficiency in subclassifying RVO and AMD, showcasing commendable sensitivity and specificity. Moreover, our models enhanced interpretability by visualizing attention weights on fundus images, aiding in the identification of disease findings. These outcomes underscore the substantial impact of our models in advancing the detection of DR, RVO, and AMD, offering the potential for improved patient outcomes and positively influencing the healthcare landscape.

A Meta-Learning Approach for Classifying Multimodal Retinal Images of Retinal Vein Occlusion With Limited Data

Adapting the Segment Anything Model for Multi-modal Retinal Anomaly Detection and Localization

Multiscale attention network for retinal vein occlusion classification with multicolor image

Automated interpretation of retinal vein occlusion based on fundus fluorescein angiography images using deep learning: A retrospective, multi-center study

A Multimodal Imaging–Based Deep Learning Model for Detecting Treatment-Requiring Retinal Vascular Diseases: Model Development and Validation Study

Discriminative ensemble meta-learning with co-regularization for rare fundus diseases diagnosis

Interpretable Detection of Diabetic Retinopathy, Retinal Vein Occlusion, Age-Related Macular Degeneration, and Other Fundus Conditions

Development and Application of an Intelligent Diagnosis System for Retinal Vein Occlusion Based on Deep Learning

Intelligent diagnosis of retinal vein occlusion based on color fundus photographs

Automated detection of myopic maculopathy using five-category models based on vision outlooker for visual recognition

DeepDrRVO: A GAN-auxiliary two-step masked transformer framework benefits early recognition and differential diagnosis of retinal vascular occlusion from color fundus photographs

Accuracy of automated machine learning in classifying retinal pathologies from ultra-widefield pseudocolour fundus images

Geometric Correspondence-Based Multimodal Learning for Ophthalmic Image Analysis

Recognition of Diabetic Retinopathy Grades Based on Data Augmentation and Attention Mechanisms

A Novel Artificial-Intelligence-Based Approach for Automatic Assessment of Retinal Disease Images Using Multi-View Deep-Broad Learning Network

Use of multimodal dataset in AI for detecting glaucoma based on fundus photographs assessed with OCT: focus group study on high prevalence of myopia

Multimodal Machine Learning Using Visual Fields and Peripapillary Circular OCT Scans in Detection of Glaucomatous Optic Neuropathy

Metadata-enhanced contrastive learning from retinal optical coherence tomography images

Comparative Study of Transfer Learning Models for Retinal Disease Diagnosis from Fundus Images

Ensemble learning for retinal disease recognition under limited resources

A difficulty-aware and task-augmentation method based on meta-learning model for few-shot diabetic retinopathy classification