Abstract:Background: With the global rise in Alzheimer disease (AD), early screening for mild cognitive impairment (MCI), which is a preclinical stage of AD, is of paramount importance. Although biomarkers such as cerebrospinal fluid amyloid level and magnetic resonance imaging have been studied, they have limitations, such as high cost and invasiveness. Digital markers to assess cognitive impairment by analyzing behavioral data collected from digital devices in daily life can be a new alternative. In this context, we developed a "virtual kiosk test" for early screening of MCI by analyzing behavioral data collected when using a kiosk in a virtual environment. Objective: We aimed to investigate key behavioral features collected from a virtual kiosk test that could distinguish patients with MCI from healthy controls with high statistical significance. Also, we focused on developing a machine learning model capable of early screening of MCI based on these behavioral features. Methods: A total of 51 participants comprising 20 healthy controls and 31 patients with MCI were recruited by 2 neurologists from a university hospital. The participants performed a virtual kiosk test-developed by our group-where we recorded various behavioral data such as hand and eye movements. Based on these time series data, we computed the following 4 behavioral features: hand movement speed, proportion of fixation duration, time to completion, and the number of errors. To compare these behavioral features between healthy controls and patients with MCI, independent-samples 2-tailed t tests were used. Additionally, we used these behavioral features to train and validate a machine learning model for early screening of patients with MCI from healthy controls. Results: In the virtual kiosk test, all 4 behavioral features showed statistically significant differences between patients with MCI and healthy controls. Compared with healthy controls, patients with MCI had slower hand movement speed (t49=3.45; P=.004), lower proportion of fixation duration (t49=2.69; P=.04), longer time to completion (t49=-3.44; P=.004), and a greater number of errors (t49=-3.77; P=.001). All 4 features were then used to train a support vector machine to distinguish between healthy controls and patients with MCI. Our machine learning model achieved 93.3% accuracy, 100% sensitivity, 83.3% specificity, 90% precision, and 94.7% F1-score. Conclusions: Our research preliminarily suggests that analyzing hand and eye movements in the virtual kiosk test holds potential as a digital marker for early screening of MCI. In contrast to conventional biomarkers, this digital marker in virtual reality is advantageous as it can collect ecologically valid data at an affordable cost and in a short period (5-15 minutes), making it a suitable means for early screening of MCI. We call for further studies to confirm the reliability and validity of this approach.

Design and implementation of a novel human-machine interactive healthcare system for visual reproduction test

Digitized Biomarkers Utilizing Human‐Computer Interaction Sensing Technology for Early Auxiliary Diagnosis of Alzheimer’s Disease

An Interactive Task Analysis Framework and Interactive System Research for Computer Aided Diagnosis

System Development and Evaluation of Human–Computer Interaction Approach for Assessing Functional Impairment for People with Mild Cognitive Impairment: A Pilot Study

Integrating digital pen devices with traditional medical screening tool for cognitive assessment

A Pilot Tool of the Virtual Scenario Initial Dementia Cognitive Screening (VSIDCS) with a Cultural Exhibition for Improving the Standard Traditional Test

Unearthing Subtle Cognitive Variations: A Digital Screening Tool for Detecting and Monitoring Mild Cognitive Impairment

Detection of Mild Cognitive Impairment Through Hand Motor Function Under Digital Cognitive Test: Mixed Methods Study

A multi-source behavioral and physiological recording system for cognitive assessment

Development of an Ergonomic User Interface Design of Calcium Imaging Processing System

Combination of Paper and Electronic Trail Making Tests for Automatic Analysis of Cognitive Impairment: Development and Validation Study

Diagnostic and Rehabilitation System for Alzheimer’s Disease Based on Virtual Reality Technology in Rehabilitation Rooms

Digital Marker for Early Screening of Mild Cognitive Impairment Through Hand and Eye Movement Analysis in Virtual Reality Using Machine Learning: First Validation Study

A new early warning method for mild cognitive impairment due to Alzheimer's disease based on dynamic evaluation of the "spatial executive process"

Design of a Gaze-Controlled Interactive Art System for the Elderly to Enjoy Life

Interactive Video Acquisition and Learning System for Motor Assessment of Parkinson's Disease.

Human-centered intelligent healthcare: explore how to apply AI to assess cognitive health

A tablet-based multi-dimensional drawing system can effectively distinguish patients with amnestic MCI from healthy individuals

Exploratory Research on Key Technology of Human-Computer Interactive 2.5-Minute Fast Digital Early Warning for Mild Cognitive Impairment

Dcdt: A Digital Clock Drawing Test System For Cognitive Impairment Screening

Automated Analysis of Drawing Process for Detecting Prodromal and Clinical Dementia