Abstract:Background: With the rapid aging of the global population, the prevalence of mild cognitive impairment (MCI) and dementia is anticipated to surge worldwide. MCI serves as an intermediary stage between normal aging and dementia, necessitating more sensitive and effective screening tools for early identification and intervention. The BrainFx SCREEN is a novel digital tool designed to assess cognitive impairment. This study evaluated its efficacy as a screening tool for MCI in primary care settings, particularly in the context of an aging population and the growing integration of digital health solutions. Objective: The primary objective was to assess the validity, reliability, and applicability of the BrainFx SCREEN (hereafter, the SCREEN) for MCI screening in a primary care context. We conducted an exploratory study comparing the SCREEN with an established screening tool, the Quick Mild Cognitive Impairment (Qmci) screen. Methods: A concurrent mixed methods, prospective study using a quasi-experimental design was conducted with 147 participants from 5 primary care Family Health Teams (FHTs; characterized by multidisciplinary practice and capitated funding) across southwestern Ontario, Canada. Participants included health care practitioners, patients, and FHT administrative executives. Individuals aged ≥55 years with no history of MCI or diagnosis of dementia rostered in a participating FHT were eligible to participate. Participants were screened using both the SCREEN and Qmci. The study also incorporated the Geriatric Anxiety Scale–10 to assess general anxiety levels at each cognitive screening. The SCREEN's scoring was compared against that of the Qmci and the clinical judgment of health care professionals. Statistical analyses included sensitivity, specificity, internal consistency, and test-retest reliability assessments. Results: The study found that the SCREEN's longer administration time and complex scoring algorithm, which is proprietary and unavailable for independent analysis, presented challenges. Its internal consistency, indicated by a Cronbach α of 0.63, was below the acceptable threshold. The test-retest reliability also showed limitations, with moderate intraclass correlation coefficient (0.54) and inadequate κ (0.15) values. Sensitivity and specificity were consistent (63.25% and 74.07%, respectively) between cross-tabulation and discrepant analysis. In addition, the study faced limitations due to its demographic skew (96/147, 65.3% female, well-educated participants), the absence of a comprehensive gold standard for MCI diagnosis, and financial constraints limiting the inclusion of confirmatory neuropsychological testing. Conclusions: The SCREEN, in its current form, does not meet the necessary criteria for an optimal MCI screening tool in primary care settings, primarily due to its longer administration time and lower reliability. As the number of digital health technologies increases and evolves, further testing and refinement of tools such as the SCREEN are essential to ensure their efficacy and reliability in real-world clinical settings. This study advocates for continued research in this rapidly advancing field to better serve the aging population. Trial Registration:

Synergy through integration of digital cognitive tests and wearable devices for mild cognitive impairment screening

Digitized Biomarkers Utilizing Human‐Computer Interaction Sensing Technology for Early Auxiliary Diagnosis of Alzheimer’s Disease

Unearthing Subtle Cognitive Variations: A Digital Screening Tool for Detecting and Monitoring Mild Cognitive Impairment

Screening for Mild Cognitive Impairment with Speech Interaction Based on Virtual Reality and Wearable Devices

Detection of Mild Cognitive Impairment Through Natural Language and Touchscreen Typing Processing

Detection of Mild Cognitive Impairment Through Hand Motor Function Under Digital Cognitive Test: Mixed Methods Study

A Novel Detection Tool for Mild Cognitive Impairment Patients Based on Eye Movement and Electroencephalogram

Early Detection of Mild Cognitive Impairment (MCI) in an At-Home Setting

Development and validity of computerized neuropsychological assessment devices for screening mild cognitive impairment: Ensemble of models with feature space heterogeneity and retrieval practice effect

Prediction of Mild Cognitive Impairment Status: Pilot Study of Machine Learning Models Based on Longitudinal Data From Fitness Trackers

Classification of Mild Cognitive Impairment Based on Handwriting Dynamics and Qeeg

Combination of Paper and Electronic Trail Making Tests for Automatic Analysis of Cognitive Impairment: Development and Validation Study

Predicting cognitive scores from wearable-based digital physiological features using machine learning: data from a clinical trial in mild cognitive impairment

A New Smart 2-Min Mobile Alerting Method for Mild Cognitive Impairment Due to Alzheimer's Disease in the Community

Developing Measures of Cognitive Impairment in the Real World from Consumer-Grade Multimodal Sensor Streams

Exploratory Research on Key Technology of Human-Computer Interactive 2.5-Minute Fast Digital Early Warning for Mild Cognitive Impairment

A new early warning method for mild cognitive impairment due to Alzheimer's disease based on dynamic evaluation of the "spatial executive process"

EEG-Based Classification Between Individuals with Mild Cognitive Impairment and Healthy Controls Using Conformal Kernel-Based Fuzzy Support Vector Machine

Psychometric Evaluation of a Tablet-Based Tool to Detect Mild Cognitive Impairment in Older Adults: Mixed Methods Study

Mild Cognitive Impairment detection based on EEG and HRV data

Feasibility of Using a Novel, Multimodal Motor Function Assessment Platform With Machine Learning to Identify Individuals With Mild Cognitive Impairment