The effectiveness of artificial intelligence-based automated grading and training system in education of manual detection of diabetic retinopathy

Xu Qian,Han Jingying,Song Xian,Zhao Yuqing,Wu Lili,Chu Baorui,Guo Wei,Zheng Yefeng,Zhang Qiang,Chu Chunyan,Bian Cheng,Ma Kai,Qu Yi
DOI: https://doi.org/10.3389/fpubh.2022.1025271
IF: 5.2
2022-11-07
Frontiers in Public Health
Abstract:Background The purpose of this study is to develop an artificial intelligence (AI)-based automated diabetic retinopathy (DR) grading and training system from a real-world diabetic dataset of China, and in particular, to investigate its effectiveness as a learning tool of DR manual grading for medical students. Methods We developed an automated DR grading and training system equipped with an AI-driven diagnosis algorithm to highlight highly prognostic related regions in the input image. Less experienced prospective physicians received pre- and post-training tests by the AI diagnosis platform. Then, changes in the diagnostic accuracy of the participants were evaluated. Results We randomly selected 8,063 cases diagnosed with DR and 7,925 with non-DR fundus images from type 2 diabetes patients. The automated DR grading system we developed achieved accuracy, sensitivity/specificity, and AUC values of 0.965, 0.965/0.966, and 0.980 for moderate or worse DR (95 percent CI: 0.976–0.984). When the graders received assistance from the output of the AI system, the metrics were enhanced in varying degrees. The automated DR grading system helped to improve the accuracy of human graders, i.e., junior residents and medical students, from 0.947 and 0.915 to 0.978 and 0.954, respectively. Conclusion The AI-based systemdemonstrated high diagnostic accuracy for the detection of DR on fundus images from real-world diabetics, and could be utilized as a training aid system for trainees lacking formal instruction on DR management.
public, environmental & occupational health
What problem does this paper attempt to address?