EE-Explorer: A Multimodal Artificial Intelligence System for Eye Emergency Triage and Primary Diagnosis
Juan Chen,Xiaohang Wu,Mingyuan LI,Lixue Liu,Liuxueying Zhong,Jun Xiao,Bingsheng Lou,Xingwu Zhong,Yanting Chen,Wenbin Huang,Xiangda Meng,Yufei Gui,Meizhen Chen,Dongni Wang,Meimei Dongye,Xulin Zhang,Carol Y. Cheung,Iat Fan Lai,Hua Yan,Xiaofeng Lin,Yongxin Zheng,Haotian Lin
DOI: https://doi.org/10.1016/j.ajo.2023.04.007
IF: 5.488
2023-01-01
American Journal of Ophthalmology
Abstract:center dot PURPOSE: To develop a multimodal artificial intelli-gence (AI) system, EE-Explorer, to triage eye emergen-cies and assist in primary diagnosis using metadata and ocular images.center dot DESIGN: A diagnostic, cross-sectional, validity and re-liability study. center dot METHODS: EE-Explorer consists of 2 models. The triage model was developed from metadata (events, symp-toms, and medical history) and ocular surface images via smartphones from 2038 patients presenting to Zhong-shan Ophthalmic Center (ZOC) to output 3 classifica-tions: urgent, semiurgent, and nonurgent. The primary diagnostic model was developed from the paired metadata and slitlamp images of 2405 patients from ZOC. Both models were externally tested on 103 participants from 4 other hospitals. A pilot test was conducted in Guangzhou to evaluate the hierarchical referral service pattern assisted by EE-Explorer for unspecialized health care facilities.center dot RESULTS: A high overall accuracy, as indicated by an area under the receiver operating characteristic curve (AUC) of 0.982 (95% CI, 0.966-0.998), was obtained using the triage model, which outperformed the triage nurses (P < .001). In the primary diagnostic model, the diagnostic classification accuracy (CA) and Hamming loss (HL) in the internal testing were 0.808 (95% CI 0.776-0.840) and 0.016 (95% CI 0.006-0.026), respec-tively. In the external testing, model performance was robust for both triage (average AUC, 0.988, 95% CI 0.967-1.000) and primary diagnosis (CA, 0.718, 95% CI 0.644-0.792; and HL, 0.023, 95% CI 0.000-0.048). In the pilot test in the hierarchical referral settings, EE-explorer demonstrated consistently robust performance and broad participant acceptance.center dot CONCLUSION: The EE-Explorer system showed robust performance in both triage and primary diagnosis for oph-thalmic emergency patients. EE-Explorer can provide pa-tients with acute ophthalmic symptoms access to remote self-triage and assist in primary diagnosis in unspecialized health care facilities to achieve rapid and effective treat-ment strategies. (Am J Ophthalmol 2023;252: 253-264.(c) 2023 The Authors. Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license ( http://creativecommons.org/licenses/by-nc-nd/4.0/ ))