Abstract:Introduction: Advances in mobile computing platforms and the rapid development of wearable devices have made possible the continuous monitoring of patients with mild cognitive impairment (MCI) and their daily activities. Such rich data can reveal more subtle changes in patients' behavioral and physiological characteristics, providing new ways to detect MCI anytime, anywhere. Therefore, we aimed to investigate the feasibility and validity of digital cognitive tests and physiological sensors applied to MCI assessment. Methods: We collected photoplethysmography (PPG), electrodermal activity (EDA) and electroencephalogram (EEG) signals from 120 participants (61 MCI patients, 59 healthy controls) during rest and cognitive testing. The features extracted from these physiological signals involved the time domain, frequency domain, time-frequency domain and statistics. Time and score features during the cognitive test are automatically recorded by the system. In addition, selected features of all modalities were classified by tenfold cross-validation using five different classifiers. Results: The experimental results showed that the weighted soft voting strategy combining five classifiers achieved the highest classification accuracy (88.9%), precision (89.9%), recall (88.2%), and F1 score (89.0%). Compared to healthy controls, the MCI group typically took longer to recall, draw, and drag. Moreover, during cognitive testing, MCI patients showed lower heart rate variability, higher electrodermal activity values, and stronger brain activity in the alpha and beta bands. Discussion: It was found that patients' classification performance improved when combining features from multiple modalities compared to using only tablet parameters or physiological features, indicating that our scheme could reveal MCI-related discriminative information. Furthermore, the best classification results on the digital span test across all tasks suggest that MCI patients may have deficits in attention and short-term memory that came to the fore earlier. Finally, integrating tablet cognitive tests and wearable sensors would provide a new direction for creating an easy-to-use and at-home self-check MCI screening tool.

A multi-source behavioral and physiological recording system for cognitive assessment

Assisting Schizophrenia Diagnosis Using Clinical Electroencephalography and Interpretable Graph Neural Networks: a Real-World and Cross-Site Study

An Extended Computer-Aided Diagnosis System for Multidomain EEG Classification

Synchronous recording and analyzing system for animal's neuronal activity and behavior

Computer-Aided Autism Spectrum Disorder Diagnosis With Behavior Signal Processing

Design and implementation of a novel human-machine interactive healthcare system for visual reproduction test

Unearthing Subtle Cognitive Variations: A Digital Screening Tool for Detecting and Monitoring Mild Cognitive Impairment

Synergy through integration of digital cognitive tests and wearable devices for mild cognitive impairment screening

A Wearable Multi-Modal Bio-Sensing System Towards Real-World Applications

A wearable group-synchronized EEG system for multi-subject brain-computer interfaces

Data-driven natural computational psychophysiology in class

Cross-subject Brain Functional Connectivity Analysis for Multi-task Cognitive State Evaluation

Pervasive brain monitoring and data sharing based on multi-tier distributed computing and linked data technology

Wearable Sensors Based Automatic Box and Block Test System.

Developing Measures of Cognitive Impairment in the Real World from Consumer-Grade Multimodal Sensor Streams

Design and Implementation of a Human-Machine Interaction Platform for Analysis on Human Cognitive Behaviors

Design of Wearable and Portable Physiological Parameter Monitoring System for Attentiveness Evaluation

ADHD Intelligent Auxiliary Diagnosis System Based on Multimodal Information Fusion.

MODMA dataset: a Multi-modal Open Dataset for Mental-disorder Analysis

Gaze-driven Interaction System for Cognitive Ability Assessment

Mt-Mcd: A Multi-Task Cognitive Diagnosis Framework For Student Assessment