Abstract:Background: Glaucoma is one of the major causes of blindness; it is estimated that over 110 million people will be affected by glaucoma worldwide by 2040. Research on glaucoma detection using deep learning technology has been increasing, but the diagnosis of glaucoma in a large population with high incidence of myopia remains a challenge. This study aimed to provide a decision support system for the automatic detection of glaucoma using fundus images, which can be applied for general screening, especially in areas of high incidence of myopia. Methods: A total of 1,155 fundus images were acquired from 667 individuals with a mean axial length of 25.60 ± 2.0 mm at the National Taiwan University Hospital, Hsinchu Br. These images were graded based on the findings of complete ophthalmology examinations, visual field test, and optical coherence tomography into three groups: normal (N, n = 596), pre-perimetric glaucoma (PPG, n = 66), and glaucoma (G, n = 493), and divided into a training-validation (N: 476, PPG: 55, G: 373) and test (N: 120, PPG: 11, G: 120) sets. A multimodal model with the Xception model as image feature extraction and machine learning algorithms [random forest (RF), support vector machine (SVM), dense neural network (DNN), and others] was applied. Results: The Xception model classified the N, PPG, and G groups with 93.9% of the micro-average area under the receiver operating characteristic curve (AUROC) with tenfold cross-validation. Although normal and glaucoma sensitivity can reach 93.51% and 86.13% respectively, the PPG sensitivity was only 30.27%. The AUROC increased to 96.4% in the N + PPG and G groups. The multimodal model with the N + PPG and G groups showed that the AUROCs of RF, SVM, and DNN were 99.56%, 99.59%, and 99.10%, respectively; The N and PPG + G groups had less than 1% difference. The test set showed an overall 3%-5% less AUROC than the validation results. Conclusion: The multimodal model had good AUROC while detecting glaucoma in a population with high incidence of myopia. The model shows the potential for general automatic screening and telemedicine, especially in Asia. Trial registration: The study was approved by the Institutional Review Board of the National Taiwan University Hospital, Hsinchu Branch (no. NTUHHCB 108-025-E).

Multiple Modality Fusion for Glaucoma Diagnosis

Multimodal Information Fusion for Glaucoma and DR Classification

A Classification Model for Glaucoma Grading Using Multi-Modal Image Fusion Strategies

Automatic Glaucoma Diagnosis Through Medical Imaging Informatics.

A Structure-Related Fine-Grained Deep Learning System with Diversity Data for Universal Glaucoma Visual Field Grading

Mstnet: method for glaucoma grading based on multimodal feature fusion of spatial relations

Multimodal Machine Learning Using Visual Fields and Peripapillary Circular OCT Scans in Detection of Glaucomatous Optic Neuropathy

Use of multimodal dataset in AI for detecting glaucoma based on fundus photographs assessed with OCT: focus group study on high prevalence of myopia

Multi-modality Fusion Learning for the Automatic Diagnosis of Optic Neuropathy

An Artificial-Intelligence- and Telemedicine-Based Screening Tool to Identify Glaucoma Suspects from Color Fundus Imaging

Artificial Intelligence and Glaucoma:Opportunities and Challenges

A Dual-Modal Fusion Network Using Optical Coherence Tomography and Fundus Images in Detection of Glaucomatous Optic Neuropathy

Fusion of Multi-Source Retinal Fundus Images Via Automatic Registration for Clinical Diagnosis

Geometric Correspondence-Based Multimodal Learning for Ophthalmic Image Analysis

Focal Biologically Inspired Feature for Glaucoma Type Classification.

Automated diagnosis of age‐related macular degeneration using multi‐modal vertical plane feature fusion via deep learning

A generalised computer vision model for improved glaucoma screening using fundus images

Representation, Alignment, Fusion: A Generic Transformer-Based Framework for Multi-modal Glaucoma Recognition

Confidence-aware multi-modality learning for eye disease screening

Multi-stage glaucoma classification using pre-trained convolutional neural networks and voting-based classifier fusion

Deep Multi-modal Fusion of Image and Non-image Data in Disease Diagnosis and Prognosis: A Review