Abstract:Diabetic retinopathy (DR), retinal vein occlusion (RVO), and age-related macular degeneration (AMD) pose significant global health challenges, often resulting in vision impairment and blindness. Automatic detection of these conditions is crucial, particularly in underserved rural areas with limited access to ophthalmic services. Despite remarkable advancements in artificial intelligence, especially convolutional neural networks (CNNs), their complexity can make interpretation difficult. In this study, we curated a dataset consisting of 15,089 color fundus photographs (CFPs) obtained from 8110 patients who underwent fundus fluorescein angiography (FFA) examination. The primary objective was to construct integrated models that merge CNNs with an attention mechanism. These models were designed for a hierarchical multilabel classification task, focusing on the detection of DR, RVO, AMD, and other fundus conditions. Furthermore, our approach extended to the detailed classification of DR, RVO, and AMD according to their respective subclasses. We employed a methodology that entails the translation of diagnostic information obtained from FFA results into CFPs. Our investigation focused on evaluating the models' ability to achieve precise diagnoses solely based on CFPs. Remarkably, our models showcased improvements across diverse fundus conditions, with the ConvNeXt-base + attention model standing out for its exceptional performance. The ConvNeXt-base + attention model achieved remarkable metrics, including an area under the receiver operating characteristic curve (AUC) of 0.943, a referable F1 score of 0.870, and a Cohen's kappa of 0.778 for DR detection. For RVO, it attained an AUC of 0.960, a referable F1 score of 0.854, and a Cohen's kappa of 0.819. Furthermore, in AMD detection, the model achieved an AUC of 0.959, an F1 score of 0.727, and a Cohen's kappa of 0.686. Impressively, the model demonstrated proficiency in subclassifying RVO and AMD, showcasing commendable sensitivity and specificity. Moreover, our models enhanced interpretability by visualizing attention weights on fundus images, aiding in the identification of disease findings. These outcomes underscore the substantial impact of our models in advancing the detection of DR, RVO, and AMD, offering the potential for improved patient outcomes and positively influencing the healthcare landscape.

Multiple Lesions Detection of Fundus Images Based on CNN Algorithm Optimized by Single Population Frog-Leaping Algorithm

Multiple Lesions Detection of Fundus Images Based on Convolution Neural Network Algorithm with Improved SFLA.

CasCRNN-GL-Net: Cascaded Convolutional and Recurrent Neural Networks with Global and Local Pathways for Classification of Focal Liver Lesions in Multi-Phase CT Images

Residual Convolutional Neural Networks With Global And Local Pathways For Classification Of Focal Liver Lesions

Combining Convolutional and Recurrent Neural Networks for Classification of Focal Liver Lesions in Multi-phase CT Images.

Multi-label classification of retinal lesions in diabetic retinopathy for automatic analysis of fundus fluorescein angiography based on deep learning

EfficientNet embedded with spatial attention for recognition of multi-label fundus disease from color fundus photographs

Multi-Stream Scale-Insensitive Convolutional And Recurrent Neural Networks For Liver Tumor Detection In Dynamic Ct Images

A Cascade Attention Network for Liver Lesion Classification in Weakly-Labeled Multi-phase CT Images.

Pseudo-Labeling for Small Lesion Detection on Diabetic Retinopathy Images

Applicability of Multidimensional Convolutional Neural Networks on Automated Detection of Diverse Focal Liver Lesions in Multiphase CT Images.

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

Mini Lesions Detection on Diabetic Retinopathy Images via Large Scale CNN Features

Lesion-aware network for diabetic retinopathy diagnosis

Multi-scale pathological fluid segmentation in OCT with a novel curvature loss in convolutional neural network

FN-OCT: Disease Detection Algorithm for Retinal Optical Coherence Tomography Based on a Fusion Network

Lesion-aware generative adversarial networks for color fundus image to fundus fluorescein angiography translation

Combining convolutional neural networks and self-attention for fundus diseases identification

FRCNN: A Combination of Fuzzy-rough-set-based Feature Discretization and Convolutional Neural Network for Segmenting Subretinal Fluid Lesions

CAF-YOLO: A Robust Framework for Multi-Scale Lesion Detection in Biomedical Imagery

Interpretable Detection of Diabetic Retinopathy, Retinal Vein Occlusion, Age-Related Macular Degeneration, and Other Fundus Conditions