Abstract:Automated fine-grained diabetic retinopathy (DR) grading was of great significance for assisting ophthalmologists in monitoring DR and designing tailored treatments for patients. Nevertheless, it is a challenging task as a result of high intra-class variations, high inter-class similarities, small lesions, and imbalanced data distributions. The pivotal factor for the success in fine-grained DR grading is to discern more subtle associated lesion features, such as microaneurysms (MA), Hemorrhages (HM), soft exudates (SE), and hard exudates (HE). In this paper, we constructed a simple yet effective deep attentive convolutional neural network (DACNN) for DR grading and lesion discovery with only image-wise supervision. Designed as a top-down architecture, our model incorporated stochastic atrous spatial pyramid pooling (sASPP), global attention mechanism (GAM), category attention mechanism (CAM), and learnable connected module (LCM) to better extract lesion-related features and maximize the DR grading performance. To be concrete, we devised sASPP combining randomness with atrous spatial pyramid pooling (ASPP) to accommodate the various scales of the lesions and struggle against the co-adaptation of multiple atrous convolutions. Then, GAM was introduced to extract class-agnostic global attention feature details, whilst CAM was explored for seeking class-specific distinctive region-level lesion feature information and regarding each DR severity grade in an equal way, which tackled the problem of imbalance DR data distributions. Further, the LCM was designed to automatically and adaptively search the optimal connections among layers for better extracting detailed small lesion feature representations. The proposed approach obtained high accuracy of 88.0% and kappa score of 88.6% for multi-class DR grading task on the EyePACS dataset, respectively, while 98.5% AUC, 93.8% accuracy, 87.9% kappa, 90.7% recall, 94.6% precision, and 92.6% F1-score for referral and non-referral classification on the Messidor dataset. Extensive experimental results on three challenging benchmarks demonstrated that the proposed approach achieved competitive performance in DR grading and lesion discovery using retinal fundus images compared with existing cutting-edge methods, and had good generalization capacity for unseen DR datasets. These promising results highlighted its potential as an efficient and reliable tool to assist ophthalmologists in large-scale DR screening.

Diabetic Retinopathy Detection Based on Weakly Supervised Object Localization and Knowledge Driven Attribute Mining.

Pseudo-Labeling for Small Lesion Detection on Diabetic Retinopathy Images

Diabetic Retinopathy Grading with Weakly-Supervised Lesion Priors

A Domain Adaptation Multi-instance Learning for Diabetic Retinopathy Grading on Retinal Images.

Lesion-aware network for diabetic retinopathy diagnosis

Fine-grained Attention & Knowledge-Based Collaborative Network for Diabetic Retinopathy Grading.

Automatic Diabetic Retinopathy Grading Via Self-Knowledge Distillation

A Cross-Domain Weakly Supervised Diabetic Retinopathy Lesion Identification Method Based on Multiple Instance Learning and Domain Adaptation.

A Novel Lesion Detection Algorithm Based on Multi-Scale Input Convolutional Neural Network Model for Diabetic Retinopathy

Deep attentive convolutional neural network for automatic grading of imbalanced diabetic retinopathy in retinal fundus images

Robust Collaborative Learning of Patch-Level and Image-Level Annotations for Diabetic Retinopathy Grading From Fundus Image

Lesion detection and Grading of Diabetic Retinopathy via Two-stages Deep Convolutional Neural Networks

Lesion-attention Pyramid Network for Diabetic Retinopathy Grading

Attention-Driven Cascaded Network for Diabetic Retinopathy Grading from Fundus Images

Joint Learning of Multi-Level Tasks for Diabetic Retinopathy Grading on Low-Resolution Fundus Images

A Deep Convolutional Neural Network for Diabetic Retinopathy Detection Via Mining Local and Long‐range Dependence

Multi-label classification of retinal lesions in diabetic retinopathy for automatic analysis of fundus fluorescein angiography based on deep learning

Multi-lesion segmentation guided deep attention network for automated detection of diabetic retinopathy

A Lesion-Fusion Neural Network for Multi-View Diabetic Retinopathy Grading

Mini Lesions Detection on Diabetic Retinopathy Images via Large Scale CNN Features

Lesion-aware attention network for diabetic nephropathy diagnosis with optical coherence tomography images