Abstract:<p>Background: Diabetic retinopathy (DR), whose standard diagnosis is performed by human experts, has high prevalence and requires a more efficient screening method. Although machine learning (ML)–based automated DR diagnosis has gained attention due to recent approval of IDx-DR, performance of this tool has not been examined systematically, and the best ML technique for use in a real-world setting has not been discussed. Objective: The aim of this study was to systematically examine the overall diagnostic accuracy of ML in diagnosing DR of different categories based on color fundus photographs and to determine the state-of-the-art ML approach. Methods: Published studies in PubMed and EMBASE were searched from inception to June 2020. Studies were screened for relevant outcomes, publication types, and data sufficiency, and a total of 60 out of 2128 (2.82%) studies were retrieved after study selection. Extraction of data was performed by 2 authors according to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses), and the quality assessment was performed according to the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Meta-analysis of diagnostic accuracy was pooled using a bivariate random effects model. The main outcomes included diagnostic accuracy, sensitivity, and specificity of ML in diagnosing DR based on color fundus photographs, as well as the performances of different major types of ML algorithms. Results: The primary meta-analysis included 60 color fundus photograph studies (445,175 interpretations). Overall, ML demonstrated high accuracy in diagnosing DR of various categories, with a pooled area under the receiver operating characteristic (AUROC) ranging from 0.97 (95% CI 0.96-0.99) to 0.99 (95% CI 0.98-1.00). The performance of ML in detecting more-than-mild DR was robust (sensitivity 0.95; AUROC 0.97), and by subgroup analyses, we observed that robust performance of ML was not limited to benchmark data sets (sensitivity 0.92; AUROC 0.96) but could be generalized to images collected in clinical practice (sensitivity 0.97; AUROC 0.97). Neural network was the most widely used method, and the subgroup analysis revealed a pooled AUROC of 0.98 (95% CI 0.96-0.99) for studies that used neural networks to diagnose more-than-mild DR. Conclusions: This meta-analysis demonstrated high diagnostic accuracy of ML algorithms in detecting DR on color fundus photographs, suggesting that state-of-the-art, ML-based DR screening algorithms are likely ready for clinical applications. However, a significant portion of the earlier published studies had methodology flaws, such as the lack of external validation and presence of spectrum bias. The results of these studies should be interpreted with caution. <br/><br/>This is the abstract only. Read the full article on the JMIR site. JMIR is the leading open access journal for eHealth and healthcare in the Internet age.</p>

Overview of global publications on machine learning in diabetic retinopathy from 2011 to 2021: Bibliometric analysis

Global trends and performances in diabetic retinopathy studies: A bibliometric analysis

Trends and hotspots in the field of diabetic retinopathy imaging research from 2000-2023

Research hotspots and trends of artificial intelligence in diabetic retinopathy based on bibliometrics and high-impact papers

A Decade of Progress in Artificial Intelligence for Fundus Image–Based Diabetic Retinopathy Screening (2014–2024): A Bibliometric Analysis

43-PUB: A Bibliometric Analysis of Machine Learning and Type 2 Diabetes from 2010 to 2023

Machine Learning and Deep Learning Techniques Applied to Diabetes Research: A Bibliometric Analysis

Systematic bibliometric and visualized analysis of research hotspots and trends on the application of artificial intelligence in diabetic retinopathy

Artificial intelligence in diabetic retinopathy: Bibliometric analysis

Trends of Diabetic Retinopathy Research from 2018-2022: A bibliometric analysis

Performance and limitation of machine learning algorithms for diabetic retinopathy screening: A meta-analysis (Preprint)

Status and Trends of the Association Between Diabetic Nephropathy and Diabetic Retinopathy From 2000 to 2021: Bibliometric and Visual Analysis

Bibliometric and visualized analysis of DME from 2012 to 2022

Knowledge structure and global trends of machine learning in stroke over the past decade: A scientometric analysis

Bibliometric and visualized analysis of diabetic macular edema

A systematic literature review of machine learning based risk prediction models for diabetic retinopathy progression

A Systematic Review on Deep Learning Techniques for Diabetic Retinopathy Segmentation and Detection Using Ocular Imaging Modalities

International publication trends in the application of artificial intelligence in ophthalmology research: an updated bibliometric analysis

Analyzing Diabetes Detection and Classification: A Bibliometric Review (2000–2023)

A critical review on diagnosis of diabetic retinopathy using machine learning and deep learning

Comparative Analysis of Diabetic Retinopathy Classification Approaches Using Machine Learning and Deep Learning Techniques