Abstract:Background: Early detection of mild cognitive impairment (MCI), a transitional stage between normal aging and Alzheimer disease, is crucial for preventing the progression of dementia. Virtual reality (VR) biomarkers have proven to be effective in capturing behaviors associated with subtle deficits in instrumental activities of daily living, such as challenges in using a food-ordering kiosk, for early detection of MCI. On the other hand, magnetic resonance imaging (MRI) biomarkers have demonstrated their efficacy in quantifying observable structural brain changes that can aid in early MCI detection. Nevertheless, the relationship between VR-derived and MRI biomarkers remains an open question. In this context, we explored the integration of VR-derived and MRI biomarkers to enhance early MCI detection through a multimodal learning approach. Objective: We aimed to evaluate and compare the efficacy of VR-derived and MRI biomarkers in the classification of MCI while also examining the strengths and weaknesses of each approach. Furthermore, we focused on improving early MCI detection by leveraging multimodal learning to integrate VR-derived and MRI biomarkers. Methods: The study encompassed a total of 54 participants, comprising 22 (41%) healthy controls and 32 (59%) patients with MCI. Participants completed a virtual kiosk test to collect 4 VR-derived biomarkers (hand movement speed, scanpath length, time to completion, and the number of errors), and T1-weighted MRI scans were performed to collect 22 MRI biomarkers from both hemispheres. Analyses of covariance were used to compare these biomarkers between healthy controls and patients with MCI, with age considered as a covariate. Subsequently, the biomarkers that exhibited significant differences between the 2 groups were used to train and validate a multimodal learning model aimed at early screening for patients with MCI among healthy controls. Results: The support vector machine (SVM) using only VR-derived biomarkers achieved a sensitivity of 87.5% and specificity of 90%, whereas the MRI biomarkers showed a sensitivity of 90.9% and specificity of 71.4%. Moreover, a correlation analysis revealed a significant association between MRI-observed brain atrophy and impaired performance in instrumental activities of daily living in the VR environment. Notably, the integration of both VR-derived and MRI biomarkers into a multimodal SVM model yielded superior results compared to unimodal SVM models, achieving higher accuracy (94.4%), sensitivity (100%), specificity (90.9%), precision (87.5%), and F1-score (93.3%). Conclusions: The results indicate that VR-derived biomarkers, characterized by their high specificity, can be valuable as a robust, early screening tool for MCI in a broader older adult population. On the other hand, MRI biomarkers, known for their high sensitivity, excel at confirming the presence of MCI. Moreover, the multimodal learning approach introduced in our study provides valuable insights into the improvement of early MCI detection by integrating a diverse set of biomarkers.

Detection of Mild Cognitive Impairment Based on Virtual Reality: A Scoping Review

Virtual reality technology in the detection of mild cognitive impairment: A systematic review and meta-analysis

A Self-Administered Immersive Virtual Reality Tool for Assessing Cognitive Impairment in Patients with Cancer

Effect of Virtual Reality on Cognitive Impairment and Clinical Symptoms among Patients with Schizophrenia in the Remission Stage: A Randomized Controlled Trial

A Virtual Supermarket Program for the Screening of Mild Cognitive Impairment in Older Adults: Diagnostic Accuracy Study

VRNPT: A Neuropsychological Test Tool for Diagnosing Mild Cognitive Impairment Using Virtual Reality and EEG Signals

Screening for Mild Cognitive Impairment with Speech Interaction Based on Virtual Reality and Wearable Devices

Integrating Biomarkers From Virtual Reality and Magnetic Resonance Imaging for the Early Detection of Mild Cognitive Impairment Using a Multimodal Learning Approach: Validation Study

The Impact of Virtual Reality-Based Products on Mild Cognitive Impairment Senior Subjects: an Experimental Study Using Multiple Sources of Data

Cognitive rehabilitation via head-mounted virtual reality technology in patients with Alzheimer's disease: A systematic review

Effects of virtual reality combined cognitive and physical interventions on cognitive function in older adults with mild cognitive impairment: A systematic review and meta-analysis

Effects of fully immersive virtual reality training on cognitive function in patients with mild cognitive impairment: a systematic review and meta-analysis

Verification of using virtual reality to evaluate deficiencies in cognitive function among patients with schizophrenia in the remission stage: a cross-sectional study

A portable and efficient dementia screening tool using eye tracking machine learning and virtual reality

Can a virtual reality cognitive training application fulfill a dual role? Using the virtual supermarket cognitive training application as a screening tool for mild cognitive impairment

A Review of the Application of Virtual Reality Technology in the Diagnosis and Treatment of Cognitive Impairment

Digital Biomarkers for the Early Detection of Mild Cognitive Impairment: Artificial Intelligence Meets Virtual Reality

Effects of Virtual Reality Intervention on Cognition and Motor Function in Older Adults With Mild Cognitive Impairment or Dementia: A Systematic Review and Meta-Analysis

Effects of immersive and non-immersive virtual reality-based rehabilitation training on cognition, motor function, and daily functioning in patients with mild cognitive impairment or dementia: A systematic review and meta-analysis

Diagnostic and Rehabilitation System for Alzheimer’s Disease Based on Virtual Reality Technology in Rehabilitation Rooms

Technology-Facilitated Detection of Mild Cognitive Impairment: A Review