Source-free Active Domain Adaptation for Diabetic Retinopathy Grading Based on Ultra-wide-field Fundus Image

Jinye Ran,Guanghua Zhang,Ximei Zhang,Juan Xie,Fan Xia,Hao Zhang
2023-09-19
Abstract:Domain adaptation (DA) has been widely applied in the diabetic retinopathy (DR) grading of unannotated ultra-wide-field (UWF) fundus images, which can transfer annotated knowledge from labeled color fundus images. However, suffering from huge domain gaps and complex real-world scenarios, the DR grading performance of most mainstream DA is far from that of clinical diagnosis. To tackle this, we propose a novel source-free active domain adaptation (SFADA) in this paper. Specifically, we focus on DR grading problem itself and propose to generate features of color fundus images with continuously evolving relationships of DRs, actively select a few valuable UWF fundus images for labeling with local representation matching, and adapt model on UWF fundus images with DR lesion prototypes. Notably, the SFADA also takes data privacy and computational efficiency into consideration. Extensive experimental results demonstrate that our proposed SFADA achieves state-of-the-art DR grading performance, increasing accuracy by 20.9% and quadratic weighted kappa by 18.63% compared with baseline and reaching 85.36% and 92.38% respectively. These investigations show that the potential of our approach for real clinical practice is promising.
Computer Vision and Pattern Recognition,Machine Learning
What problem does this paper attempt to address?
The paper primarily addresses the issue of Diabetic Retinopathy (DR) grading, particularly its application on Ultra-wide-field (UWF) fundus images. The core objective of the research is to propose a novel method to solve the following problems: 1. **Cross-domain adaptation challenges**: Although existing deep learning methods have achieved good DR grading performance on traditional fundus color images, their application on UWF fundus images is still limited by the significant domain gap and the difficulty of annotating such images. Therefore, the paper aims to develop a method that can effectively transfer the knowledge from traditional fundus images to UWF fundus images. 2. **Data privacy and computational efficiency**: Considering the data privacy issues and computational resource constraints in practical application scenarios, the research needs to design a method that can perform domain adaptation without directly accessing source domain data, and this method should have high computational efficiency. 3. **Improving DR grading performance**: By addressing the above issues, the ultimate goal is to significantly improve the DR grading accuracy on UWF fundus images, making it close to or reaching the level of clinical diagnosis. To achieve these goals, the paper proposes a new framework called "Source-Free Active Domain Adaptation" (SFADA). This framework mainly includes the following aspects: - **Source domain feature generation**: By training a source domain pre-trained model and a source feature generator, it can generate source domain features to support the subsequent domain adaptation process even without directly accessing source domain data. - **Active local representation matching**: Select some valuable UWF fundus images for annotation, reduce the impact of outliers through local representation matching, and ensure that the selected samples can represent the entire target domain. - **Lesion prototype-based domain adaptation**: Utilize the selected annotated samples, combine the characteristics of the lesion areas to perform domain contrast alignment, domain consistency regularization, and pseudo-label selection, thereby further optimizing the model. Experimental results show that the proposed SFADA method significantly improves the DR grading performance on UWF fundus images while ensuring data privacy and computational efficiency.