A graph convolutional network with dynamic weight fusion of multi-scale local features for diabetic retinopathy grading

Yipeng Wang,Liejun Wang,Zhiqing Guo,Shiji Song,Yanhong Li

DOI: https://doi.org/10.1038/s41598-024-56389-4

IF: 4.6

2024-03-11

Scientific Reports

Abstract:Diabetic retinopathy (DR) is a serious ocular complication that can pose a serious risk to a patient's vision and overall health. Currently, the automatic grading of DR is mainly using deep learning techniques. However, the lesion information in DR images is complex, variable in shape and size, and randomly distributed in the images, which leads to some shortcomings of the current research methods, i.e., it is difficult to effectively extract the information of these various features, and it is difficult to establish the connection between the lesion information in different regions. To address these shortcomings, we design a multi-scale dynamic fusion (MSDF) module and combine it with graph convolution operations to propose a multi-scale dynamic graph convolutional network (MDGNet) in this paper. MDGNet firstly uses convolution kernels with different sizes to extract features with different shapes and sizes in the lesion regions, and then automatically learns the corresponding weights for feature fusion according to the contribution of different features to model grading. Finally, the graph convolution operation is used to link the lesion features in different regions. As a result, our proposed method can effectively combine local and global features, which is beneficial for the correct DR grading. We evaluate the effectiveness of method on two publicly available datasets, namely APTOS and DDR. Extensive experiments demonstrate that our proposed MDGNet achieves the best grading results on APTOS and DDR, and is more accurate and diverse for the extraction of lesion information.

multidisciplinary sciences

What problem does this paper attempt to address?

The paper aims to address key issues in the automatic grading of Diabetic Retinopathy (DR). Specifically, the research has made improvements in the following aspects:

1. **Complex and Variable Lesion Information**: The lesion information in DR images is very complex, with varying shapes and sizes, and is randomly distributed in the images. This makes it difficult for existing methods to effectively extract these features.

2. **Correlation of Lesion Information Between Different Regions**: Existing technologies find it challenging to establish connections between lesion information in different regions of the image, which is crucial for accurate grading.

3. **Multi-Scale Feature Extraction and Fusion**: A module named "Multi-Scale Dynamic Fusion" (MSDF) is proposed, which can extract lesion features of different shapes and sizes and dynamically learn the corresponding weights for feature fusion based on the importance of the features to the model grading.

4. **Combination of Local and Global Features**: By combining the MSDF module with graph convolution operations, a network named "Multi-Scale Dynamic Graph Convolutional Network" (MDGNet) is designed, which can effectively combine local and global features, thereby improving the accuracy of DR grading.

In summary, the main goal of this paper is to propose a new deep learning framework, MDGNet, to overcome the issues encountered by existing methods in processing DR images and to improve the performance of automatic grading. To validate the effectiveness of the proposed MDGNet, researchers conducted extensive experiments on two publicly available datasets, APTOS and DDR. The results show that this method can achieve better DR grading performance.