Abstract:Diabetic retinopathy (DR), retinal vein occlusion (RVO), and age-related macular degeneration (AMD) pose significant global health challenges, often resulting in vision impairment and blindness. Automatic detection of these conditions is crucial, particularly in underserved rural areas with limited access to ophthalmic services. Despite remarkable advancements in artificial intelligence, especially convolutional neural networks (CNNs), their complexity can make interpretation difficult. In this study, we curated a dataset consisting of 15,089 color fundus photographs (CFPs) obtained from 8110 patients who underwent fundus fluorescein angiography (FFA) examination. The primary objective was to construct integrated models that merge CNNs with an attention mechanism. These models were designed for a hierarchical multilabel classification task, focusing on the detection of DR, RVO, AMD, and other fundus conditions. Furthermore, our approach extended to the detailed classification of DR, RVO, and AMD according to their respective subclasses. We employed a methodology that entails the translation of diagnostic information obtained from FFA results into CFPs. Our investigation focused on evaluating the models' ability to achieve precise diagnoses solely based on CFPs. Remarkably, our models showcased improvements across diverse fundus conditions, with the ConvNeXt-base + attention model standing out for its exceptional performance. The ConvNeXt-base + attention model achieved remarkable metrics, including an area under the receiver operating characteristic curve (AUC) of 0.943, a referable F1 score of 0.870, and a Cohen's kappa of 0.778 for DR detection. For RVO, it attained an AUC of 0.960, a referable F1 score of 0.854, and a Cohen's kappa of 0.819. Furthermore, in AMD detection, the model achieved an AUC of 0.959, an F1 score of 0.727, and a Cohen's kappa of 0.686. Impressively, the model demonstrated proficiency in subclassifying RVO and AMD, showcasing commendable sensitivity and specificity. Moreover, our models enhanced interpretability by visualizing attention weights on fundus images, aiding in the identification of disease findings. These outcomes underscore the substantial impact of our models in advancing the detection of DR, RVO, and AMD, offering the potential for improved patient outcomes and positively influencing the healthcare landscape.

Searching Discriminative Regions for Convolutional Neural Networks in Fundus Image Classification With Genetic Algorithms

Residual Convolutional Neural Networks With Global And Local Pathways For Classification Of Focal Liver Lesions

Model Doctor: A Simple Gradient Aggregation Strategy for Diagnosing and Treating CNN Classifiers

Interpretable Detection of Diabetic Retinopathy, Retinal Vein Occlusion, Age-Related Macular Degeneration, and Other Fundus Conditions

Fundus Image Generation and Classification of Diabetic Retinopathy Based on Convolutional Neural Network

Explaining Deep Convolutional Neural Networks for Image Classification by Evolving Local Interpretable Model-agnostic Explanations

Diabetic retinopathy detection and classification using CNN tuned by genetic algorithm

Interpretable Learning: A Result-Oriented Explanation for Automatic Cataract Detection

Explainable Convolutional Neural Networks for Retinal Fundus Classification and Cutting-Edge Segmentation Models for Retinal Blood Vessels from Fundus Images

An Artificial Intelligent Risk Classification Method of High Myopia Based on Fundus Images

Optimizing mammography interpretation education: leveraging deep learning for cohort-specific error detection to enhance radiologist training

HCT-net: hybrid CNN-transformer model based on a neural architecture search network for medical image segmentation

Automatic Cataract Detection And Grading Using Deep Convolutional Neural Network

Optimized Dropkey-Based Grad-CAM: Toward Accurate Image Feature Localization

Artificial intelligence as a gateway to scientific discovery: Uncovering features in retinal fundus images

Fine-Grained Gastrointestinal Endoscopy Image Categorization

Detection of Exudates in Fundus Photographs with Imbalanced Learning Using Conditional Generative Adversarial Network

DG-CNN: Introducing Margin Information into Convolutional Neural Networks for Breast Cancer Diagnosis in Ultrasound Images

GDC Block: Gradient-Guided Direction-Aware Convolution Block for Image Classification

Cataract recognition and grading based on deep learning

Automatically Designing CNN Architectures Using the Genetic Algorithm for Image Classification