Evaluating the accuracy of the Ophthalmologist Robot for multiple blindness-causing eye diseases: a multicentre, prospective study protocol

Qixin Li,Jie Tan,He Xie,Xiaoyu Zhang,Qi Dai,Zhongwen Li,Lijing L Yan,Wei Chen,Li,Q.,Tan,J.,Xie,H.,Zhang,X.,Dai,Q.,Li,Z.,Yan,L. L.,Chen,W.

DOI: https://doi.org/10.1136/bmjopen-2023-077859

IF: 3.006

2024-03-03

BMJ Open

Abstract:Introduction Early eye screening and treatment can reduce the incidence of blindness by detecting and addressing eye diseases at an early stage. The Ophthalmologist Robot is an automated device that can simultaneously capture ocular surface and fundus images without the need for ophthalmologists, making it highly suitable for primary application. However, the accuracy of the device's screening capabilities requires further validation. This study aims to evaluate and compare the screening accuracies of ophthalmologists and deep learning models using images captured by the Ophthalmologist Robot, in order to identify a screening method that is both highly accurate and cost-effective. Our findings may provide valuable insights into the potential applications of remote eye screening. Methods and analysis This is a multicentre, prospective study that will recruit approximately 1578 participants from 3 hospitals. All participants will undergo ocular surface and fundus images taken by the Ophthalmologist Robot. Additionally, 695 participants will have their ocular surface imaged with a slit lamp. Relevant information from outpatient medical records will be collected. The primary objective is to evaluate the accuracy of ophthalmologists' screening for multiple blindness-causing eye diseases using device images through receiver operating characteristic curve analysis. The targeted diseases include keratitis, corneal scar, cataract, diabetic retinopathy, age-related macular degeneration, glaucomatous optic neuropathy and pathological myopia. The secondary objective is to assess the accuracy of deep learning models in disease screening. Furthermore, the study aims to compare the consistency between the Ophthalmologist Robot and the slit lamp in screening for keratitis and corneal scar using the Kappa test. Additionally, the cost-effectiveness of three eye screening methods, based on non-telemedicine screening, ophthalmologist-telemedicine screening and artificial intelligence-telemedicine screening, will be assessed by constructing Markov models. Ethics and dissemination The study has obtained approval from the ethics committee of the Ophthalmology and Optometry Hospital of Wenzhou Medical University (reference: 2023-026 K-21-01). This work will be disseminated by peer-review publications, abstract presentations at national and international conferences and data sharing with other researchers. Trial registration number ChiCTR2300070082.

medicine, general & internal

What problem does this paper attempt to address?

This paper aims to evaluate the accuracy of using the "Ophthalmologist Robot" for screening multiple blinding eye diseases, and compare it with the screening accuracy of traditional ophthalmologists and deep - learning models. Specifically, the main objective of the study is to evaluate the accuracy of ophthalmologists in screening multiple blinding eye diseases (such as keratitis, corneal scar, cataract, diabetic retinopathy, age - related macular degeneration, glaucomatous optic neuropathy and pathological myopia) using the images captured by the "Ophthalmologist Robot" through Receiver Operating Characteristic Curve (ROC) analysis.

The secondary objectives of the study include:
1. Evaluate the accuracy of deep - learning models in screening multiple blinding eye diseases using the images captured by the "Ophthalmologist Robot", also using ROC curve analysis.
2. Use the Kappa test to evaluate the consistency between the images captured by the "Ophthalmologist Robot" and the anterior segment eye images captured by the slit - lamp in screening keratitis and corneal scar.
3. Evaluate the cost - effectiveness of three eye disease screening methods (non - telemedicine screening, ophthalmologist telemedicine screening and artificial intelligence telemedicine screening). The main indicator is the number of years of blindness avoided, and the Incremental Cost - Effectiveness Ratios (ICERs) will be calculated as:
\[ \text{ICERs}=\frac{\text{Incremental cost}}{\text{Incremental effect}} \]

Through these objectives, the study hopes to provide valuable insights for remote eye disease screening and explore a screening method that is both accurate and cost - effective to promote primary eye care services in communities and remote areas.