Abstract:Background and objective Early detection and grading of Diabetic Retinopathy (DR) is essential to determine an adequate treatment and prevent severe vision loss. However, the manual analysis of fundus images is time consuming and DR screening programs are challenged by the availability of human graders. Current automatic approaches for DR grading attempt the joint detection of all signs at the same time. However, the classification can be optimized if red lesions and bright lesions are independently processed since the task gets divided and simplified. Furthermore, clinicians would greatly benefit from explainable artificial intelligence (XAI) to support the automatic model predictions, especially when the type of lesion is specified. As a novelty, we propose an end-to-end deep learning framework for automatic DR grading (5 severity degrees) based on separating the attention of the dark structures from the bright structures of the retina. As the main contribution, this approach allowed us to generate independent interpretable attention maps for red lesions, such as microaneurysms and hemorrhages, and bright lesions, such as hard exudates, while using image-level labels only. Methods Our approach is based on a novel attention mechanism which focuses separately on the dark and the bright structures of the retina by performing a previous image decomposition. This mechanism can be seen as a XAI approach which generates independent attention maps for red lesions and bright lesions. The framework includes an image quality assessment stage and deep learning-related techniques, such as data augmentation, transfer learning and fine-tuning. We used the architecture Xception as a feature extractor and the focal loss function to deal with data imbalance. Results The Kaggle DR detection dataset was used for method development and validation. The proposed approach achieved 83.7% accuracy and a Quadratic Weighted Kappa of 0.78 to classify DR among 5 severity degrees, which outperforms several state-of-the-art approaches. Nevertheless, the main result of this work is the generated attention maps, which reveal the pathological regions on the image distinguishing the red lesions and the bright lesions. These maps provide explainability to the model predictions. Conclusions Our results suggest that our framework is effective to automatically grade DR. The separate attention approach has proven useful for optimizing the classification. On top of that, the obtained attention maps facilitate visual interpretation for clinicians. Therefore, the proposed method could be a diagnostic aid for the early detection and grading of DR.

Enhancing semi‐supervised contrastive learning through saliency map for diabetic retinopathy grading

Diabetic Retinopathy Grading Base on Contrastive Learning and Semi-supervised Learning

Lesion-Aware Contrastive Learning for Diabetic Retinopathy Diagnosis

Lesion-based Contrastive Learning for Diabetic Retinopathy Grading from Fundus Images

Contrastive Self-Supervised Learning for Diabetic Retinopathy Early Detection.

Deep attentive convolutional neural network for automatic grading of imbalanced diabetic retinopathy in retinal fundus images

Supervised Contrastive Learning with Angular Margin for the Detection and Grading of Diabetic Retinopathy.

Image Quality Assessment Guided Collaborative Learning of Image Enhancement and Classification for Diabetic Retinopathy Grading

Robust Collaborative Learning of Patch-Level and Image-Level Annotations for Diabetic Retinopathy Grading From Fundus Image

Semi-Supervised Adversarial Learning For Diabetic Retinopathy Screening

Retinal Disease Diagnosis with Unsupervised Grad-CAM Guided Contrastive Learning

Fine-grained Attention & Knowledge-Based Collaborative Network for Diabetic Retinopathy Grading.

Screening and Grading of Fundus Images of Diabetic Retinopathy Based on Visual Attention

Semi-Supervised Auto-Encoder Graph Network for Diabetic Retinopathy Grading

Attention-based Deep Learning Framework for Automatic Fundus Image Processing to Aid in Diabetic Retinopathy Grading

Multi-Scale Class Attention Network for Diabetes Retinopathy Grading

Grading the severity of diabetic retinopathy using an ensemble of self-supervised pre-trained convolutional neural networks: ESSP-CNNs

Learning Discriminative Representations for Fine-Grained Diabetic Retinopathy Grading

Leveraging Semi-Supervised Graph Learning for Enhanced Diabetic Retinopathy Detection

Automatic Diabetic Retinopathy Grading Via Self-Knowledge Distillation

Attention-Driven Cascaded Network for Diabetic Retinopathy Grading from Fundus Images