Multimodal Machine Learning Using Visual Fields and Peripapillary Circular OCT Scans in Detection of Glaucomatous Optic Neuropathy
Jian Xiong,Fei Li,Diping Song,Guangxian Tang,Junjun He,Kai Gao,Hengli Zhang,Weijing Cheng,Yunhe Song,Fengbin Lin,Kun Hu,Peiyuan Wang,Ji-Peng Olivia Li,Tin Aung,Yu Qiao,Xiulan Zhang,Daniel Ting
DOI: https://doi.org/10.1016/j.ophtha.2021.07.032
IF: 14.277
2022-02-01
Ophthalmology
Abstract:PurposeTo develop and test a multi-modal artificial intelligence (AI) algorithm, FusionNet, using the pattern deviation probability plots (PDPs) from visual field (VF) reports and circular peripapillary optical coherence tomography (OCT) to detect glaucomatous optic neuropathy (GON).DesignCross-sectional study.SubjectsA total of 2463 pairs of VF and OCT images from 1083 patients.MethodsA novel deep learning algorithm (FusionNet) based on bimodal input of VF-OCT paired data was developed to detect GON. VF data were collected using Humphrey Field Analyzer (HFA). OCT images were collected from three types of devices (DRI-OCT, Cirrus OCT and Spectralis OCT). A total of 2463 pairs of VF and OCT images were divided into four datasets: 1567 for training (HFA and DRI-OCT), 441 for primary validation (HFA and DRI-OCT), 255 for the internal test set (HFA and Cirrus OCT), and 200 for the external test set (HFA and Spectralis OCT). GON was defined as retinal nerve fibre layer (RNFL) thinning with corresponding VF defects.Main Outcome MeasuresThe diagnostic performance of FusionNet was compared with that of VFNet (with VF data as input) and OCTNet (with OCT data as input).ResultsFusionNet achieved an area under the receiver operating characteristic curve (AUROC) of 0.950 (0.931-0.968) and outperformed VFNet (AUROC: 0.868 [0.834-0.902]), OCTNet (AUROC: 0.809 [0.768-0.850]), and two glaucomatologists (AUROC: 0.882 [0.847-0.917], AUROC: 0.883 [0.849-0.918]) in the primary validation set. In the internal and external test sets, FusionNet performance continued to be superior (AUROC: 0.917 [0.876-0.958], AUROC: 0.873 [0.822-0.924]) to VFNet (AUROC: 0.854 [0.796-0.912], AUROC: 0.772 [0.707-0.838]), and OCTNet (AUROC: 0.811 [0.753-0.869], AUROC: 0.785 [0.721-0.850]). There was no significant difference between the two glaucomatologists (AUROC: 0.869 [0.818-0.920] and 0.839 [0.777-0.901]; AUROC: (0.841 [0.780-0.902]) and FusionNet in the internal and external test sets, except for glaucomatologist 2 (AUROC:0.858 [0.805-0.912]) in the internal test set.ConclusionsFusionNet, developed using paired VF-OCT data, demonstrated superior performance to both VFNet and OCTNet in detecting GON, suggesting multi-modal machine learning models are valuable in detecting GON.
ophthalmology