Abstract:Importance: A retinopathy of prematurity (ROP) diagnosis currently relies on indirect ophthalmoscopy assessed by experienced ophthalmologists. A deep learning algorithm based on retinal images may facilitate early detection and timely treatment of ROP to improve visual outcomes. Objective: To develop a retinal image-based, multidimensional, automated, deep learning platform for ROP screening and validate its performance accuracy. Design, setting, and participants: A total of 14 108 eyes of 8652 preterm infants who received ROP screening from 4 centers from November 4, 2010, to November 14, 2019, were included, and a total of 52 249 retinal images were randomly split into training, validation, and test sets. Four main dimensional independent classifiers were developed, including image quality, any stage of ROP, intraocular hemorrhage, and preplus/plus disease. Referral-warranted ROP was automatically generated by integrating the results of 4 classifiers at the image, eye, and patient levels. DeepSHAP, a method based on DeepLIFT and Shapley values (solution concepts in cooperative game theory), was adopted as the heat map technology to explain the predictions. The performance of the platform was further validated as compared with that of the experienced ROP experts. Data were analyzed from February 12, 2020, to June 24, 2020. Exposure: A deep learning algorithm. Main outcomes and measures: The performance of each classifier included true negative, false positive, false negative, true positive, F1 score, sensitivity, specificity, receiver operating characteristic, area under curve (AUC), and Cohen unweighted κ. Results: A total of 14 108 eyes of 8652 preterm infants (mean [SD] gestational age, 32.9 [3.1] weeks; 4818 boys [60.4%] of 7973 with known sex) received ROP screening. The performance of all classifiers achieved an F1 score of 0.718 to 0.981, a sensitivity of 0.918 to 0.982, a specificity of 0.949 to 0.992, and an AUC of 0.983 to 0.998, whereas that of the referral system achieved an F1 score of 0.898 to 0.956, a sensitivity of 0.981 to 0.986, a specificity of 0.939 to 0.974, and an AUC of 0.9901 to 0.9956. Fine-grained and class-discriminative heat maps were generated by DeepSHAP in real time. The platform achieved a Cohen unweighted κ of 0.86 to 0.98 compared with a Cohen κ of 0.93 to 0.98 by the ROP experts. Conclusions and relevance: In this diagnostic study, an automated ROP screening platform was able to identify and classify multidimensional pathologic lesions in the retinal images. This platform may be able to assist routine ROP screening in general and children hospitals.

A Deep Learning Model to Predict the Occurrence and Severity of Retinopathy of Prematurity

Development and Validation of a Semi-Supervised Deep Learning Model for Automatic Retinopathy of Prematurity Staging

Prediction models for retinopathy of prematurity occurrence based on artificial neural network

Automated Explainable Multidimensional Deep Learning Platform of Retinal Images for Retinopathy of Prematurity Screening

EVALUATION OF ARTIFICIAL INTELLIGENCE-BASED QUANTITATIVE ANALYSIS TO IDENTIFY CLINICALLY SIGNIFICANT SEVERE RETINOPATHY OF PREMATURITY

An Interpretable System for Screening the Severity Level of Retinopathy in Premature Infants Using Deep Learning

Early Detection of Retinopathy of Prematurity (ROP) in Retinal Fundus Images Via Convolutional Neural Networks

Development and validation of an artificial intelligence based screening tool for detection of retinopathy of prematurity in a South Indian population

Automatic retinopathy of prematurity stagingwith a semi-supervised deep learning method based on dual consistency regularization

Diabetic Retinopathy Detection Using Prognosis of Microaneurysm and Early Diagnosis System for Non-Proliferative Diabetic Retinopathy Based on Deep Learning Algorithms

Multi-risk factors joint prediction model for risk prediction of retinopathy of prematurity

Retinopathy of Prematurity Stage Diagnosis Using Object Segmentation and Convolutional Neural Networks

A Deep Learning System for Predicting Time to Progression of Diabetic Retinopathy

Computer-Aided Diagnosis of Early-Stage Retinopathy of Prematurity in Neonatal Fundus Images Using Artificial Intelligence

A deep learning system for detecting diabetic retinopathy across the disease spectrum

Vessels Characteristics in Familial Exudative Vitreoretinopathy and Retinopathy of Prematurity Based on Deep Convolutional Neural Networks.

Applying novel self‐supervised learning for early detection of retinopathy of prematurity

A Deep-Learning-Based Collaborative Edge-Cloud Telemedicine System for Retinopathy of Prematurity

A Deep-learning Approach for Prognosis of Age-Related Macular Degeneration Disease using SD-OCT Imaging Biomarkers

Current and future roles of artificial intelligence in retinopathy of prematurity

Nomogram to predict severe retinopathy of prematurity in Southeast China