Abstract:Objective To evaluate the intraphysician agreement between ophthalmoscopic examination and image-based telemedical interpretation for retinopathy of prematurity (ROP) diagnosis, when performed by the same expert physician grader. Design Prospective, nonrandomized, comparative study. Participants Sixty-seven consecutive premature infants who underwent ROP examination at a major university medical center whose parents consented for participation. Methods Infants underwent standard dilated ophthalmoscopy by one of two pediatric ophthalmologists, followed by retinal imaging with a commercially available wide-angle fundus camera by a trained neonatal nurse. Study examinations were performed at 31 to 33 weeks postmenstrual age (PMA) and/or 35 to 37 weeks PMA. Images were uploaded to a Web-based telemedicine system developed by the authors. After a 4- to 12-month period, telemedical interpretations were performed in which each physician graded images from infants upon whom he had initially performed ophthalmoscopic examinations. Diagnoses were classified using an ordinal scale: no ROP, mild ROP, type 2 prethreshold ROP, and treatment-requiring ROP. Main Outcome Measures Absolute intraphysician agreement and κ statistic between ophthalmoscopic examination and telemedical interpretation were calculated by eye. All intraphysician discrepancies were reviewed, and underlying causes were classified by eye as no ROP identified by ophthalmoscopic examination, no ROP identified by telemedical interpretation, discrepancy about presence of zone 1 ROP, discrepancy about presence of plus disease, or other discrepancy in classification of ROP stage. Results Absolute intraphysician agreement between ophthalmoscopic examination and telemedical interpretation was 86.3%. The κ statistic for intraphysician agreement between examinations ranged from 0.657 (substantial agreement) for diagnosis of treatment-requiring ROP to 0.854 (near-perfect agreement) for diagnosis of mild or worse ROP. Among 206 eye examinations (103 infant examinations), there were 28 (13.6%) intraphysician discrepancies in diagnosis, 8 of which resulted from uncertainty about presence of zone 1 disease and 4 from uncertainty about presence of plus disease. Conclusions Intraphysician agreement between ophthalmoscopic examination and telemedical interpretation for ROP was very high. Neither examination modality appeared to have a systematic tendency to overdiagnose or underdiagnose ROP. Diagnosis of zone 1 disease and plus disease were major sources of clinically significant discrepancies. To evaluate the intraphysician agreement between ophthalmoscopic examination and image-based telemedical interpretation for retinopathy of prematurity (ROP) diagnosis, when performed by the same expert physician grader. Prospective, nonrandomized, comparative study. Sixty-seven consecutive premature infants who underwent ROP examination at a major university medical center whose parents consented for participation. Infants underwent standard dilated ophthalmoscopy by one of two pediatric ophthalmologists, followed by retinal imaging with a commercially available wide-angle fundus camera by a trained neonatal nurse. Study examinations were performed at 31 to 33 weeks postmenstrual age (PMA) and/or 35 to 37 weeks PMA. Images were uploaded to a Web-based telemedicine system developed by the authors. After a 4- to 12-month period, telemedical interpretations were performed in which each physician graded images from infants upon whom he had initially performed ophthalmoscopic examinations. Diagnoses were classified using an ordinal scale: no ROP, mild ROP, type 2 prethreshold ROP, and treatment-requiring ROP. Absolute intraphysician agreement and κ statistic between ophthalmoscopic examination and telemedical interpretation were calculated by eye. All intraphysician discrepancies were reviewed, and underlying causes were classified by eye as no ROP identified by ophthalmoscopic examination, no ROP identified by telemedical interpretation, discrepancy about presence of zone 1 ROP, discrepancy about presence of plus disease, or other discrepancy in classification of ROP stage. Absolute intraphysician agreement between ophthalmoscopic examination and telemedical interpretation was 86.3%. The κ statistic for intraphysician agreement between examinations ranged from 0.657 (substantial agreement) for diagnosis of treatment-requiring ROP to 0.854 (near-perfect agreement) for diagnosis of mild or worse ROP. Among 206 eye examinations (103 infant examinations), there were 28 (13.6%) intraphysician discrepancies in diagnosis, 8 of which resulted from uncertainty about presence of zone 1 disease and 4 from uncertainty about presence of plus disease. Intraphysician agreement between ophthalmoscopic examination and telemedical interpretation for ROP was very high. Neither examination modality appeared to have a systematic tendency to overdiagnose or underdiagnose ROP. Diagnosis of zone 1 disease and plus disease were major sources of clinically significant discrepancies.

Diagnostic Accuracy of Pediatrician-performed Digital Retinal Imaging with 3nethra neo for ROP Screening

Development and validation of an artificial intelligence based screening tool for detection of retinopathy of prematurity in a South Indian population

Efficacy of Smartphone-Based Telescreening for Retinopathy of Prematurity With and Without Artificial Intelligence in India

Telemedical Diagnosis of Retinopathy of Prematurity

Multinational External Validation of Autonomous Retinopathy of Prematurity Screening

Retinopathy of Prematurity Outcomes of Neonates Meeting Only a Single Screening Criterion: Proposal of the TWO-ROP Algorithm

EVALUATION OF ARTIFICIAL INTELLIGENCE-BASED QUANTITATIVE ANALYSIS TO IDENTIFY CLINICALLY SIGNIFICANT SEVERE RETINOPATHY OF PREMATURITY

Automated Explainable Multidimensional Deep Learning Platform of Retinal Images for Retinopathy of Prematurity Screening

Evaluating the Feasibility of a Telescreening Program for Retinopathy of Prematurity (ROP) in Denmark

External Validation of a Retinopathy of Prematurity Screening Model Using Artificial Intelligence in 3 Low- and Middle-Income Populations

An Artificial Intelligence System for Screening and Recommending the Treatment Modalities for Retinopathy of Prematurity

Comparison of RetCam and Smartphone-Based Photography for Retinopathy of Prematurity Screening

Current Application of Digital Diagnosing Systems for Retinopathy of Prematurity

Computer-Aided Diagnosis of Early-Stage Retinopathy of Prematurity in Neonatal Fundus Images Using Artificial Intelligence

Outcome of real-time telescreening for retinopathy of prematurity using videoconferencing in a community setting in Eastern India

Characterization of Errors in Retinopathy of Prematurity Diagnosis by Ophthalmologists-in-Training in Middle-Income Countries

Automated assisted clinical diagnosis of retinopathy of prematurity based on deep learning

ULTRA–WIDE-FIELD IMAGING AND INTRAVENOUS FUNDUS FLUORESCEIN ANGIOGRAPHY IN INFANTS WITH RETINOPATHY OF PREMATURITY

Smartphone-based fundus imaging for evaluation of Retinopathy of Prematurity in a low-income country: A pilot study

An Interpretable System for Screening the Severity Level of Retinopathy in Premature Infants Using Deep Learning

Prevalence of Unscreened Premature Infants Presenting With Advanced Stages of Retinopathy of Prematurity in South India: An Analysis of 220 Eyes